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Abstract  (continued) 

-  The  order  of  processing  a  query  does  not  affect  the  speed.  Thus  there  is  no 
need  for  heuristics  and  monitors  to  determine  the  most  efficient  way  to  pro¬ 
cess  a  query. 

-  Although  we  do  not  receive  anywhere  near  an  n-fold  speedup  by  using  n  pro¬ 
cessors,  we  still  receive  significant  performance  benefits  over  a  single  pro¬ 
cessor. 

-  The  associative  network  may  be  used  not  just  as  a  semantic  network,  for 
example,  it  also  allows  some  problems  involving  numerical  minimizations  to 
be  solved  efficiently. 

The  primary  result  of  this  work  is  that  a  large  number  of  simple  processors, 
each  responsible  for  a  small  piece  of  information,  can  work  in  unison  to  answer 
queries  significantly  faster  than  a  single,  highly  complex  processor  can. 
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associative  networks  by  first  describing  semantic  networks  and  then  formalizing 
associative  networks.  The  second  chapter  describes  the  parallel  processor 
upon  which  we  will  implement  associative  networks.  Chapter  three  describes 
this  implementation  in  detail.  In  chapter  four,  examples  are  given  and  expected 
timing  results  are  compared  to  a  sequential  method.  Chapter  five  considers 
numerical  calculations.  Finally,  chapter  six  discusses  limitations  and  pos¬ 
sible  extensions  of  this  method. 
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INTRODUCTION 


Many  natural  language  projects  in  the  past  fifteen  years  have  used 
semantic  networks  as  their  underlying  knowledge  representation  (Brachman 
{1979],  Hendrix  [1979]).  In  a  separate  realm,  recent  breakthroughs  in 
very-large  scale  integration  (VLSI)  have  lead  to  designs  for  machines  with 
vast  numbers  of  processors  (Schwartz  [1980],  Vagner  [1983]).  In  this  paper 
vre  will  marry  these  two  technologies.  A  generalization  of  semantic 
networks,  called  an  associative  network  (Findler  [1979]),  will  be  mapped 
onto  a  massively  parallel  processor  which  is  currently  under  development. 
The  results  shall  show: 


*  The  time  required  to  process  a  query  is  dependent  strictly  on 
the  pattern  of  the  query,  not  on  the  size  of  the  classes  being 
processed.  A  system  built  using  this  knowledge  representatiop 
will  give  consistent  semantic  processing  performance. 

«  The  order  of  processing  a  query  does  not  affect  the  speed.  Thus 
there  is  no  need  for  heuristics  and  monitors  to  determine  the 
most  efficient  way  to  process  e  query. 

•  Although  we  do  not  receive  anywhere  near  an  n-fold  speedup  by 
using  n  processors,  we  still  receive  significant  performance 
benefits  over  a  single  processor. 

«  The  associative  network  may  be  used  not  just  as  a  semantic 
network;  for  example,  it  also  allows  some  problems  involving 
numerical  minimizations  to  be  solved  efficiently. 


The  primary  result  of  this  work  is  that  a  large  number  of  simple 
processors,  each  responsible  for  a  small  piece  of  information,  can  work  in 
unison  to  answer  queries  significantly  faster  than  a  single,  highly  complex 


processor  can. 
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This  paper  has  the  following  structure.  The  first  chapter  introduces 
Associative  networks  by  first  describing  semantic  networks  and  then 
formalizing  associative  networks.  The  second  chapter  describes  the  parallel 
processor  upon  which  we  will  implement  associative  networks.  Chapter 
three  describes  this  implementation  in  detail.  In  chapter  four,  examples  are 
given  and  expected  timing  results  are  compared  to  a  sequential  method. 
Chapter  five  considers  numerical  calculations.  Finally,  chapter  six  discusses 
limitations  and  possible  extensions  of  this  method. 


CHAPTER  1 


Associative  Networks 

Associative  networks  are  a  generalization  of  semantic  networks  (Findler 
[1079]).  Semantic  networks  have  been  a  common  method  for  knowledge 
representation  in  natural  language  systems  (Brachman  [1979],  Hendrix 
[1979]).  Associative  networks  may  be  used  for  virtually  any  application 
whose  knowledge  base  may  be  represented  in  network  form. 

1.1.  Semantic  Networks  and  Natural  Language 

Figure  1.1  shows  a  part  of  a  semantic  network  for  a  "family"  data  base. 
Nodes  ere  labeled  with  the  names  of  individuals,  classes  of  individuals.1  and 
attributes  of  individuals  (such  as  "tan").  An  arc  is  labeled  with  the 
relationship  that  bolds  between  the  nodes  it  connects.  Host  arcs  are 
directed:  "job"  points  from  "John"  to  "engineer".  (Note  that,  in  the  text, 
words  in  double  quotes  are  labels  of  arcs  and  nodes.)  But  other  arcs,  such  as 
'’married"  are  undirected;  one  may  represent  an  undirected  arc  by  two  arcs 
both  labeled  the  same,  one  pointing  in  each  direction.  Queries  are  answered 
by  traversing  the  network.  "What  is  Jane’s  spouse's  job?"  may  be  answered 
by  traversing  the  "married"  arc  from  "Jane"  to  "John”  and  then  the  "job"  arc 

•There  arc  epistemological  problem*  with  rnivvwg  the  use  of  individuals  and  classes  of  indi¬ 
viduals.  Bvcq  in  this  simple  data  base  we  can  envision  problems  if  we  try  to  represent  the  fact 
that  there  are  "lots  of  dofC  by  merely  attaching  such  a  fact  to  the  dog  node.  Rather  than  get¬ 
ting  involved  in  these  problems,  h  is  sufficient  to  remember  that  we  are  building  an  wadeHywip 
vs*j roe ■  ni atocm  upon  which  systems  of  various  kinds  may  be  buih..  Brachman  [lBTfi]  frees  a 
■ood  summary  of  the  issues  surrounding  the  representation  used  in  this  paper.  Be  will  use  it 
because  it  is  intuitive,  not  because  we  behevc  it  to  be  theoretically  best. 
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to  tbe  uimr .  "engineer". 

Computational  complexity  rises  quickly  as  the  queries  become  more 
Involved  and  larger  groups  of  nodes  must  be  processed.  Consider  a 
semantic  network  for  a  company  having  ten  thousand  employees,  several 
pieces  of  information  stored  concerning  each  employee,  and  a  hierarchy  of 
bosses  leading  from  a  dock  worker  to  the  president  of  tbe  company.  A  query 
such  as  "which  female  employees  have  a  boss  whose  boss  is  female”  would 
require  eccessing  tens  of  thousands  of  records  and  following  at  least  as 
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many  links. 

The  possibility  of  employing  a  parallel  computer  to  improve  the  query 
processing  performance  appears  fruitful  since  queries  may  be  processed  by- 
working  on  sets  of  nodes  at  a  time.  Consider,  for  example,  "Who  are  the 
grandchildren  of  John?"  We  can  think  of  gathering  together  the  nodes  which 
are  the  children  of  John,  giving  each  of  them  to  a  separate  processor,  and 
then  having  these  processors  simultaneously  find  the  grandchildren.  We  will 
see  in  chapter  three  that  our  implementation  actually  goes  a  bit  farther 
than  this  in  building  a  parallel  associative  network. 

12.  Associative  Networks 

A  semantic  network  is  loosely  defined  as  a  network  whose  arcs  and 
nodes  are  labeled  with  words.  This  dependence  on  words  to  give  meaning  to 
the  network  is  both  a  positive  and  negative  trait  (Bracbman  [1979]).  The 
definition  we  give  of  associative  networks  eliminates  words  end  meanings 
altogether  in  favor  of  numbers.  It  is  assumed  to  be  a  function  of  a  higher 
level  of  the  system  (e.  g.  a  natural  language  front  end)  to  assign  meanings  to 
these  numbers. 

In  the  forward  to  his  book,  Associative  Networks:  Representation  and 
Eke  of  Knowledge  by  Computers,  Windier  [1979]  describes  the  difference 
between  semantic  networks  and  associative  networks  as  follows: 

The  main  theme  of  this  book  is  associative  networks.  I  have  deliberately 
•voided  the  term  semantic  networks,...  to  indicate  that  the  former  are  more 
general  in  objectives  and,  possibly,  in  structure  than  the  latter.  Semantic 
networks  aim,  I  believe,  at  furnishing  a  representation  for  linguistic  utter¬ 
ances  to  capture  underlying  relations  of  words  and  to  produce  the  informa¬ 
tion  contained  in  text...  Indirectly,  they  also  reveal  the  intricacies  and  use 
of  language...  Associative  networks,  on  the  other  hand,  could,  but  need  not, 
he  language-independent...  Associative  networks  ere  constructed  to  serve 
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as  the  knowladgt  bast  of  program  that  exhibit  some  operational  aspects  of 
understanding 

As  associative  network  can  be  defined  formally  as  a  set  of  nodes  and  a 
set  of  arcs.  A  node  is  simply  e  positive  integer.  An  arc  has  three  parts:  the 
from-node,  the  relation  and  the  to-node.  The  from-node  is  the  number  of 
the  node  from  which  the  arc  emanates.  The  to-node  is  the  number  of  the 
node  to  which  the  arc  points.  The  relation  is  the  object  that  labels  the  arc: 
for  now  we  will  assume  that  it  is  an  integer.  Given  the  following  piece  of  a 
semantic  network: 


nodes:  (1,2.4) 

•res:  ((4,5.2), (4.3,1)) 

Vi  thin  this  simple  framework  we  can  represent  semantic  networks  as 


well  as  other  types  of  information. 
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1J3.  Associative  Networks:  A  Numerical  Example 

As  as  example  of  an  associative  network  which  involves  numerical 
processing,  suppose  one  wishes  to  use  a  computer  to  find  optimal  trips 
between  cities  in  the  United  States.  Optimal  might  mean  fastest  or  shortest 
An  associative  network  may  be  used  to  build  such  a  data  base.  Consider  an 
associative  network  where  the  nodes  are  cities  and  the  relation  of  an  arc  is 
a  triple  which  has  three  parts:  a  highway  number,  a  distance  in  miles,  and  a 
travel  time  in  minutes.  (American  Automobile  Association  maps  include 
estimated  times  for  each  major  route.)  This  associative  network  will  allow  us 
to  answer  queries  such  as: 


•  What  is  the  fastest  route  from  Baltimore  to  Richmond? 

•  What  is  the  shortest  route  from  Raleigh  to  Washington  DC. 

•  Kow  long  does  it  take  to  get  from  Boston  to  each  city? 

•  Does  the  shortest  route  from  Philadelphia  to  St.  Louis  use 
highway  40? 

Section  5.4  discusses  this  date  base  in  greater  depth. 


CHAPTER  2 


The  Boolean  Vector  Machine 


2.1.  Massive  Parallelism 

In  years  past,  "parallel  processing"  referred  to  a  few  processors 
working  simultaneously  on  a  relatively  short  vector  of  numbers  to  speed  up 
numerical  calculations.  Recent  advances  in  VLSI  technology  allow  us  to 
consider  building  computers  which  consist  of  thousands  or  even  millions  of 
processors,  and  lead  to  new  ways  of  thinking  about  computing  (Mago  [1980], 
Snyder  {1982]). 

To  achieve  this  massive  parallelism,  one  must  use  simple  processors. 
One  method  employs  a  single  controller  responsible  for  decoding  the 
machine  instruction.  Once  decoded,  the  instruction  is  broadcast  to  all 
processors  at  the  same  time,  and  each  processor  executes  this  instruction 
on  its  local  data.  This  machine  organization  is  called  Single  Instruction 
Multiple  Data  (SIMS)  (Flynn  (1972]).  The  processors  which  make  up  such  a 
system  are  generally  called  Processing  Elements  (PEs). 

Having  a  million  PEs  each  of  which  can  only  operate  on  its  isolated  data 
is  a  grave  limitation  in  functionality.  Instead  an  interconnection  network 
needs  to  be  designed  which  allows  processors  to  share  information.  Many 
interconnection  patterns  have  been  suggested;  A  good  overview  is  presented 
in  Peng  [1981]  which  describes  mesh,  shuffle-exchange,  flip,  and  Benes  as 
well  as  other  interconnection  alternatives. 
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With  the  combination  of  large  numbers  of  processors  and  a  powerful 
interconnection  network,  significant  time  improvements  can  be  achieved 
(Schwartz  [19B0]). 


2 2.  Organisation  of  the  Boolean  Vector  Machine 

The  Boolean  Vector  Machine  (BVM)  is  one  such  massively  parallel 
computer  (Vagner  [19B1],  Vagner  Il9B3]).  The  design  of  the  BVM  calls  for 
one  million  PEs1  interconnected  using  cube  connected  cycles  (as  shown 
below).  The  next  section  describes  a  typical  PE  and  following  that  the 
interconnection  network  will  be  described. 


22.1.  A  Typical  Processor  of  the  BVM 

A  processor  in  the  BVM  is  very  simple.  Each  PE  has  about  200  bits  of 
local  memory.  The  only  calculation  a  PE  may  make  is  a  boolean  function  of 
three  variables.  (Addition,  for  example,  must  be  handled  bit-wise.)  Of  the 
three  input  variables,  two  must  he  from  a  PE's  local  memory  while  the  third 
may  be  from  one  of  three  PEs  to  which  the  PE  is  connected  (see  the  next 
section). 


1 A  prototype  BVM  vith  £048  PS*  it  currently  under  construction. 
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2.2J2.  The  Interconnection  Network  of  the  BVU 

The  interconnection  network  used  on  the  BVM  is  celled  cube  connected 
cycles  (Preparate  [1981]).  It  is  an  outgrowth  of  the  binary  n-cube.  In  a 
binary  n-cube.  the  PEs  are  numbered  from  0  to  N-l  for  some  N  =  2t.  Each 
processor  may  access  the  n  PEs  which  differ  in  exactly  one  of  the  n  bit 
positions  of  the  processor  number.  For  example,  with  N=B,  PE  0  has  a 
lateral  connection  to  PEs  1,  2  and  4;  PE  5  is  connected  to  PEs  4,  7  and  1. 
Unfortunately,  a  binary  n-cube  is  too  expensive  to  build.  Each  PE  in  a  one 
million  PE  machine  would  need  twenty  interconnections.  Instead  the  BVU 
uses  cube  connected  cycles  (CCC). 

To  understand  the  CCC  interconnection  network,  consider  each  PE  to 
be  defined  uniquely  by  a  pair  of  integers  <cycle-number.  elernent-number>. 
Cycle-number  ranges  from  0  to  2*-l.  while  element-number  ranges  from  0 
to  K-l.  for  some  fixed  K.  The  PE  numbered  <ij>  is  said  to  be  in  the  ith  cycle 
and  to  be  in  position  j  within  the  cycle.  There  are  N  -  K  x  2*  processors  in 
the  machine.  For  a  machine  with  one  million  processors,  we  have  K=16. 

The  PEs  can  be  seen  as  residing  in  an  array  where  each  cycle  is  a  row. 
Tbe  interconnections  within  a  row  are  cyclical:  PE  <ij>  is  connected  to  a 
successor  PE  number  <i,(j+ 1)  mod  K>  and  a  predecessor  PE  number  <i,(j-l) 
mod  K>. 

Unlike  a  mesh- connected  system,  where  each  PE  would  also  have 
connections  ’‘north"  and  "south"  (Barnes  [1968]),  tbe  CCC  interconnection 
uses  a  single  connection  to  the  lateral  PE.  Tbe  lateral  to  a  given  PE  <ij>  is 
that  PE  in  cycle  position  j  of  tbe  cycle  whose  cycle  number  differs  from  i  in 
the  jtb  bit  position.  Examples:  PE  <0,0>  is  connected  to  PE  <1,0>;  PE  <0.1> 
is  connected  to  PE  <2,1>;  and  PE  <15, 3>  is  connected  to  PE  <7,3>.  Figure 
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n-eube  efficiently  (as  shown  in  appendix  A). 

2.2-3.  Programming  Aspects  of  the  BVM 

For  our  purposes,  one  can  think  of  programming  the  3VM  as  writing  a 
program  which  is  executed  simultaneously,  statement  by  statement,  by  each 
processor.  (We  will  ignore  input/output  issues,  granting  that  1/0  is  a 
eerious  question  which  deserves  further  study.)  We  will  assume  that  all 
ancillary  procedures  are  available  for  such  standard  operations  as  addition, 
multiplication,  minimum  and  maxi  mum.  In  our  timing  results,  of  course,  we 
•will  take  into  account  the  bit-wise  nature  of  the  BVM.  IF.  THEN  .ELSE 
constructs  may  be  used,  but,  given  the  parallelism,  both  the  THEN  and  ELSE 
clauses  must  be  executed  serially. 


CHAPTER  3 


Implementation  of  an  Associative  Network  on  the  BVH 

Fahlman  [1978]  gives  an  in-depth  description  of  how  a  semantic 
network  could  use  specialized  massively  parallel  hardware  to  achieve 
dramatic  performance  improvements.  Fahlman  [1982]  submits  a  hardware 
design  for  such  a  machine.  This  paper  attempts  a  different  approach. 
Instead  of  building  a  machine  explicitly  for  processing  networks,  we  will 
adapt  the  BVM,  a  general  purpose,  massively  parallel  computer. 

3.1.  Some  Options 

So  far  we  have  seen  that  associative  networks  provide  a  framework  for 

♦ 

problem-solving,  lfe  have  described  the  BVM,  a  computer  with  one  million 
processors.  Now,  how  can  we  implement  the  former  on  the  latter? 

A  first  attempt  might  be  to  give  to  each  processor  one  node  of  the 
associative  network.  This  fails  for  several  reasons.  First,  the  number  of  arcs 
emitting  from  and  pointing  to  a  given  node  is  not  fixed.  Given  the  limited 
eixe  of  a  processor’s  local  memory,  there  is  no  guarantee  that  all  of  the 
information  about  a  node  will  fit  in  a  single  processor.  Second,  how  does 
one  traverse  the  network?  Since  each  processor  has  only  three  links,  one 
cannot  use  hardware  links  for  arcs. 

Another  possibility  is  to  give  a  single  arc  to  each  processor.  This  solves 
the  previous  problem  of  limited  space.  Each  processor  maintains  its  from- 
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node  and  to-node  numbers  as  well  as  Us  relation.  Once  again,  however,  it  is 
not  at  all  clear  how  queries  may  be  processed.  Again  consider  the  query 
"Who  are  John's  grandchildren?"  To  start,  it  is  easy  to  find  "John’s  children". 
Those  processors  with  "John"  as  the  from-r.ode  and  parent  as  the  relation 
have  a  child  as  the  to-node.  At  this  point,  however,  one  would  have  to 
sequentially  step  through  each  child  to  find  their  children.  This  defeats  the 
purpose  of  introducing  parallelism.  (Tombouiian  [19B4]  shows  a  possible 
■way  around  this  problem.) 

32.  The  Implementation  Choice 

Our  implementation  of  an  associative  network  on  the  BVW  splits 
information  down  to  the  lowest  level.  Instead  of  having  one  processor  per 
node  or  one  processor  per  arc,  we  will  have  one  processor  per  from-node 
and  to-node  in  each  arc.  Thus,  a  processor  only  maintains  its  node  number 
and  relation.  The  two  processors  which  make  up  an  arc  are  connected  in 
hardware  by  their  lateral  link  (described  in  section  2.2.3).  Thus  "job  of  John 
is  engineer”  consists  of  two  processors:  one  is  a  "John”  processor  with 
relation  "job";  the  other  is  an  "engineer"  processor  with  relation  "inverse 
job".  (We  think  of  a  processor  as  belonging  to  the  node  it  contains 
information  about;  thus  we  say  a  "John”  processor,  or  a  processor  with  type 
"John".)  There  will  be  many  "John"  processors  and  many  "Jane”  processors, 
etc.  Further,  they  will  be  scattered  throughout  the  machine  due  to  the 
lateral  connection  requirement. 

Let  us  look  again  at  the  query  "Who  are  John’s  grandchildren?"  Using 
eur  new  layout,  it  is  easy  to  turn  on  a  child  processor  in  each  of  John's 


children.  (We  use  turn  on  a  processor  to  mean  set  a  bit  to  true  in  the 
processor.)  If  all  of  the  children  processors  were  on,  it  would  be  simple  to 
find  the  grandchildren.  The  missing  step,  then,  is  an  algorithm  which  turns 
on  all  the  processors  of  a  particular  type  if  any  of  that  type  are  already  on. 
"We  call  this  algorithm  shore  since  it  shares  information  among  processors  of 
the  same  type. 

3.3  The  Share  Algorithm 

Share  uses  the  CCC  interconnection  scheme  of  the  BVM  to 
simultaneously  bring  together  a  piece  of  information  from  all  processors  of 
each  type.  Figure  3.1  shows  snapshots  of  a  small  associative  network  as  it 
answers  "Who  are  John's  grandchildren?’  The  sequence  of  steps  needed  to 
find  John's  grandchildren  are  listed.  Note  that  the  triangles  in  the  figure 
represent  each  of  the  processors  and  only  the  bits  of  information  used  in 
the  calculation  are  listed. 

If  we  wish  to  handle  "What  is  owned  by  John’s  grandchildren?"  we  use 
what  we  have  done,  appending  another  share  and  another  ’’turn  on"  step 
which  we  will  call  a  match  step.  These  match-share  pairs  allow  a  wide  range 
of  queries  to  be  processed  (as  shown  in  chapter  4).  In  section  4.1.2  we  will 
formalize  the  match  statements. 

The  share  algorithm  works  by  simultaneously  bringing  information 
together  from  all  processors  of  each  type.  In  step  two  of  the  figure  above, 
one  "Jack”  and  one  "Jill"  processor  have  bit  A  on;  no  other  processors  have 
bit  A  on.  When  we  use  algorithm  share  on  bit  A.  the  system  simultaneously 
determines  that  all  "Jack"  processors  and  all  "Jill"  processors  are  to  have  bit 


(1)  Turn  on  bit  A  in  processors  with  relation  "inverse  parent-of  and  whose 
lateral  is  of  type  "John". 

(2)  Apply  the  share  algorithm  to  bit  A 

(3)  Turn  on  bit  B  in  processors  with  relation  "inverse  parent-of  and  whose 
lateral  has  bit  A  on. 

Figure  3.1:  Calculating  "John’s  grandchildren"  (the  triangles  are  processors) 


A  on.  while  "John".  "Joan",  "Jake"  and  "Joe"  processors  are  to  have  bit  A  off. 
The  algorithm  works  in  two  steps.  First  we  concentrate  information  about 
each  node.  In  this  case,  we  OR  together  all  bit  A  values  for  each  node  as 
they  are  concentrated.  The  second  step  returns  the  concentrated  value  to 
each  PE  of  each  type.  Since  the  problem  above  involves  sending  a  single  bit 
of  information,  operation  OR  is  the  natural  choice.  Share  may  also  be  used 
on  integers,  in  which  case  one  must  determine  what  operation  to  perform. 
The  most  useful  operations  are  ADD.  ION  and  MAX. 


Figure  3.2  The  steps  in  share  with  operation  ADD 
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3-4.  Timing  Besults  tar  Selected  Operations 

As  proved  in  appendix  A.  the  share  algorithm  takes  24  log2(N)  BVM 
operations  per  bit  in  the  object  to  be  shared.  Since  the  BVM  has  a  cycle  time 
of  250ns  (Wagner  [1994]),  and  logz(N)  is  20  for  the  one  million  PE  machine, 
the  share  algorithm  will  take  120/zs,  per  bit. 

Since  the  BVM  is  a  bit-oriented  machine,  the  size  of  integers  affects  the 
results  we  will  achieve.  Throughout  we  will  use  20  bit  integers.  This  unusual 
choice  is  made  for  several  reasons.  First,  20  bits  is  sufficient  to  range  to  one 
million;  the  nodes  may  be  represented  uniquely  in  20  bits  for  otherwise  the 
•network  would  not  fit  in  the  machine.  Second,  20  bits  is  a  natural  number 
for  this  machine  since  it  equals  log i(S),  which  appears  in  many  standard 
timing  results.  Thus  if  an  Algorithm  takes  log28(N)  steps  per  bit,  it  will  take 
steps  per  word.  Finally,  on  a  machine  with  a  250ns  cycle  time,  we 
will  get  results  which  are  multiples  of  5 fis  per  word,  which  are  particularly 
easy  to  manipulate. 

The  operations  to  be  performed  on  words  are  numerical  comparisons 
(less  than,  equal,  greater  than),  minimum  and  maximum,  and  addition.  Each 
of  these  operations  will  take  5 ps  if  only  one  address  calculation  is  necessary. 
This  is  the  case  if  the  input  and  output  variables  are  at  the  same  position  in 
the  processor,  but  the  values  may  be  in  a  processor  connected  by  a 
hardware  link.  Thus  doubling  a  number  in  place  may  be  accomplished  in  5^ts 
by  adding  it  to  itself  (x  «-x+x).  Also  two  numbers  may  be  added  in  5^is  if  they 
are  in  the  same  place  in  connected  processors  (x«-x  +  connectedx);  this  is 
the  case  in  the  share  algorithm.  Other  forms  of  numerical  operations  will 
take  1G  and  15^is  for  two  and  three  address  computations  respectively. 


CHAPTER  4 


Implementing  Data  Bases 


In  this  chapter  we  will  describe  two  date  bases  and  formally  define  bow 
queries  may  be  processed.  A  simple  language  will  be  developed  first  which 
allows  us  to  "program"  queries  for  the  BVM. 

4.1.  A  Query  Programming  language 

To  control  the  now  of  information  through  the  network  requires  some 
formal  specification  of  what  the  network  is  to  do  at  each  step.  This  section 
describes  a  language  that  allows  us  to  describe  bow  a  query  may  be 
resolved.  The  language  below  is  procedural  in  nature:  the  system  executes  a 
aeries  of  statements,  each  of  which  performs  some  manipulation  upon  the 
network  as  a  whole.  It  should  be  remembered  that  one  would  generally  build 
n  natural  language  processing  system,  such  as  Thompson's  POL  system 
(Thompson  [1981]).  -whose  input  would  be  user  queries  and  whose  output 
would  be  a  series  of  statements  in  this  Language. 


4.1.1.  The  BVM.  as  the  Language  Sees  it 

From  the  language's  vantage,  the  system  consists  of  e  set  of  PE's,  and 
each  PE  contains:  a  set  of  marl:  Wfs  which  are  boolean  toggles  and  can  be 
•et  or  read;  a  set  of  storage  wards  which  may  be  set  and  manipulated  using 
mrithmetic;  a  type  Kefrf,  which  is  an  integer  whose  value  defines  the  node  in 


the  associative  network  to  which  this  processor  belongs;  and  finally  a 
relation  field,  which  is  an  integer  whose  value  defines  the  relation  arc  in  the 
network  to  which  this  processor  is  connected. 

A  processor  (PE)  may  access  its  own  local  information  and  the 
information  stored  in  the  PE  on  the  other  end  of  its  relation  arc,  the 
associated  processor.  (On  the  BVM  the  associated  PE  is  connected  to  this  PE 
by  its  lateral  link.)  If  a  relation  arc  is  directed,  the  sign  of  the  relation  field 
determines  the  direction  of  the  arc:  positive,  away  from  this  node;  negative, 
toward  this  node.  Consider  the  following  example  data  base  which  contains 
the  two  pieces  of  information  "John  loves  Mary"  and  The  job  of  John  is 
engineer"  with  the  following  numerical  assignments: 

name _ number  code  or  arc 


engineer 

1 

code 

job 

2 

•it 

jobc 

3 

code 

loves 

4 

arc 

mary 

5 

code 

and  the  following  processor  assignments: 
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4.12.  The  Language  Definition 

Returning  to  our  language,  we  shall  assume  a  standard  pseudo¬ 
language  similar  to  Pascal,  limit  the  set  of  variables,  and  add  a  few 
specialized  procedures.  Then  we  will  be  able  to  write  '‘programs"  which  are 
executed  on  every  PE  within  the  system. 

The  variables  we  allow  are:  M0-M9  for  ten  mark  bits;  S0-S4  for  five 
storage  words;  TYP  for  the  type  field;  and  REL  for  the  relation  field.  (The 
choice  of  ten  mark  bits  and  five  storage  words  is  arbitrary.)  Further,  any  of 
these  variables  may  be  preceded  by  the  letter  "A"  to  refer  to  information  in 
the  associated  PE.  Now,  the  language  will  allow  assignments  to  the  (local) 
variables  using  the  •-  symbol.  Mark  bits  are  assigned  boolean  expressions, 
which  may  include  integer  comparators  such  as  “less  than"  (<).  as  well  as 
the  boolean  operators  such  as  "and"  (jc).  Storage  words  are  assigned 
integer  expressions  involving  operators  such  as  "plus”  (-*■)  and  "min"  (MIX). 
The  storage  word  assignment  expressions  may  be  preceded  by  an  IF  clause 
specifying  a  mark  bit  such  that  only  those  storage  words  are  assigned  if  the 
appropriate  mark  bit  is  on.  (A  WHILE  construct  is  also  available,  but 
requires  a  specialized  function  as  its  predicate.  See  the  next  section.)  The 
following  is  a  list  of  sample  statements; 

MO  -  Ml  &  (AM5  V  AM2); 

M4  «-  (NOT  AMI)  V  (SO  <  AS2); 

S4  «-  0; 

SI  *■  AS3; 

S3  -  S1  +  (AS2  -3); 

JF  M2  THEN  S2  -  S3; 
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4.1-3  Specialised  Procedures  and  Functions 

Tbe  additions  necessary  to  use  this  language  for  querying  are 
implemented  as  built-in  procedures  and  functions.  The  share  algorithm  is 
executed  by  a  SHARE  procedure  which  takes  as  a  parameter  the  bit  or  word 
upon  which  the  algorithm  is  to  be  executed.  If  SHARE  is  executed  on  a  word, 
the  operation  to  be  applied  to  the  values  as  they  are  brought  together  must 
be  specified.  The  following  are  sample  uses  of  the  SHARE  procedure. 

SHAKE  (M2); 

SHARE(SO.ADD): 

SHARE(S2,MTN); 

An  important  function  is  ANY.  Passed  a  bit  in  the  BVM,  ANY’  sets  the 
mark  bit  which  is  its  parameter  to  true  if  any  processor  has  this  bit  on,  and 
false  if  none  does.  ANY  can  also  be  used  as  a  function  which  returns  the 
true  or  false  value;  this  value  may  be  used  with  the  control  structure  IF  or 
WHILE-  We  will  see  that  this  function  is  critical  when  traversing  hierarchies. 

A  PRINT  statement  is  provide  as  well.  This  procedure  executes  the 
concentrate  portion  of  SHARE,  just  to  tbe  point  where  the  value  for  each 
node  has  been  determined.  Instead  of  then  spreading  the  concentrated 
values  among  processors,  PRINT  displays  the  value  each  node  has.  When 
PRINT  is  called  with  a  mark  bit,  the  names  of  those  nodes  which  have  tbe  bit 
on  are  printed  out.  (This  is  the  extent  to  which  we  will  handle  1/0.) 

Other  functions  will  be  Introduced  as  they  are  needed. 


4.1.4.  Network- Specific  Constants 


Ac  associative  network  is  built  of  numbers,  but  for  our  purposes  we 
care  little  wbat  number  is  assigned  to  each  node.  We  don't  care  whether 
"John”  is  mapped  to  32  or  30172.  as  long  as  this  value  is  unique  to  "John”. 
To  make  our  programs  readable  and  flexible,  we  will  assume  that  constants 
are  defined  for  each  node  and  arc  label  in  the  data  base.  The  constant  will 
be  the  label  preceded  by  a  pound  sign  (#).  Thus  if  we  wish  to  set  MO  to  true 
in  all  processors  with  node  "John”  and  relation  "parent- of,  we  say: 

MO  *-  (TYP  =  #John)  A  (REL  =  #parent-of); 

Our  language  is  now  independent  of  the  exact  numerical  assignments 
chosen. 


42.  The  Family  Data  Base 

Tbe  "family”  data  base  describes  a  fictitious  family  and  their 
relationships  with  other  people,  animals  and  objects.  This  simple  data  base 
will  allow  us  to  explore  the  breadth  of  queries  which  may  be  answered  and  to 
deal  with  some  of  the  difficulties  that  arise. 

Although  tbe  data  base  is  small,  a  diagram  of  the  whole  network  is 
unwieldy.  Instead  the  data  base  is  described  using  lists  of  relations.  Figure 
4.1  describes  the  entire  data  base.  Each  relation  is  named,  followed  by  the 
list  of  pairs  which  have  that  relationship.  From  the  line 
job((jo  he  ,engineer).(jane, doctor),...) 

we  discern  that  John's  job  is  engineer,  Jane's  job  is  doctor,  etc.  Figure  1.1 
displays  a  portion  of  the  data  base  as  a  network. 
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*ta((jobn,man).(jeck.man),(mark,inan),(joe,man),(jeke,man).(pete.man)) 
i*a((jftne,'woiiian),(mary,woman).(jiU.wonian)1Ooan.woman),(pal,woman)) 
isa((man,male),(woman, female),  (man, human).(woman, human)) 
iaa((human,anima])) 

job((john.engineer).(mary, doctor), (jack, welder),(mark.doetor)) 
boss((john.pete),(jack.pat)) 

{  salary  is  in  thousands  of  dollars  ) 

•alary{(john.30),(joseph,40).(manfred.l00).(mary.45)) 

salary((pete,40),{pat,45)) 

parent((john  jack),(jane.jack),(john,jiil),(jane,jill)) 
parent((mary,joan),(jaclcjoan),(mary,jake),(jackjake)) 
parent((jlii,joe),(  mark  joe)) 
xnarried((johnjane),(j®ek,mary),(jill.niark)) 

own((john,porsbe),(mary. corvette), (mark.mercedes)) 
own((jake,fido).(jake.fluffy).(jih.poop5y)) 
isa((porshe.car),(corvette,car).(mercedes.car)) 
isn((fido,dog).(poopsy.dog). (fluffy  .cat)} 
isa((dog.pet).(cat,pet)) 

isa((fido,male).(poopsy.feniale).(fluffy,female)) 
color  ffporshe,blue).(mercedes.blue),(corvette, tan)) 
color{(poopsy, tan). (fido.tan).(fluffy  .grey)) 
color((jake,white).(jill,tan),(mark.  tan), (jack,  white)) 

Figure  4.1  The  family  data  base 


▼hat  sort  of  questions  can  be  answered  using  this  data  base?  We  may 
ask  questions  concerning  familial  relations,  jobs  and  salaries,  possessions 
*nd  colors.  The  list  of  queries  below  will  be  used  to  demonstrate  some  of  the 
features  of  the  system. 

•  What  is  John’s  job? 

•  Who  are  Jobs's  children? 

•  Who  is  the  son  of  John? 

•  Who  are  the  parents  of  a  tan  dog  owner? 

•  What  cars  are  tan? 

•  Who  are  Joe’s  ancestors? 
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4.2.1.  What  is  John's  job? 

To  answer  this  simple  query  requires  marking  those  names  which  ore 
the  values  of  relation  ’‘job”  applied  to  “John".  In  network  terminology,  we 
need  to  return  those  nodes  to  which  “John"  has  a  job  arc.  In  our  language 
we  can  achieve  this  as  follows: 

MO  -  (REL=  -#job)  tc  (ATYP  =  #john); 

Print(MO); 

Note  the  use  of  -#job,  since  the  result  is  the  node  toward  which  the  relation 
arc  points. 


4 22.  Who  are  John's  children? 

I 

This  query  is  processed  analogously  to  the  previous  one  except  that  we 
expect  several  responses. 

**  • 

MO  *•  (REL  =  -jjtparent)  &  (ATYP  =  #john); 

Print(MO); 


422.  Who  Is  the  son  of  John? 


Since  "son"  means  "male  child",  we  will  first  Find  all  children  of  John, 
and  then  ferret  out  those  who  are  not  male. 


MO  *■  {REL  s  -f  parent)  &  (ATYP  =  f  john); 

Share(MO); 

{We  now  have  all  processors  for  children  of  John  turned  on.} 
Ml  -  MO  k  (REL  =  fist)  fc  (ATYP  =  #male); 

Print(Ml); 


I 
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42.4.  Who  are  the  parents  of  a  tan  dog  owner? 


Note  that  this  query  is  ambiguous.  In  the  program  listing  below,  "(tan 
dog)  owner"  is  on  the  left  "tan  (dog  owner)"  is  on  the  right.  Code  common  to 
both  meanings  is  on  the  left.  It  would  be  up  to  the  natural  language  front 
end  to  determine  which  query  is  meant,  or  to  run  both  end  respond  with 
both  results. 

(First  set  VC  to  dogs] 

BO  (REL  *  gisa)  *  (A7YP  =  gdcg), 

Share(UO); 


(Find  tac  dogs] 

(Find  dog  owners] 

Bl  *-  BO  A  (REL  *  g  color) 

A  (A7YP  *  gtac). 

U 1  -  AUC  *  (REL  *  gowns); 

Share(Ml); 

Share(lil); 

(Find  owners  of  tac  dogs] 

(Find  dog  owners  who  are  tac] 

B2  -  AVI  k  (REL  *gcwrs) 

U2  «-  VI  k  (REL  =  gcclcr) 

A  (A7YP  «  f  tac); 

Share(M2), 

Stare(B2). 

(Find  parects  of  codes  with  M<{ 
113  «-  AH2  A  (REL  =  gparect). 
Prict(HZ). 


42J5.  That  cars  are  tan? 

Although  humans  automatically  know  that  "tan"  Is  s  color  and  thus  only 
color  arcs  are  of  interest  in  solving  this  query,  no  such  generalization  is 
made  by  our  query  system.  Instead,  a  search  will  be  performed  for  any  cars 
which  have  a  connection  to  "tan".  The  parallel  nature  of  the  search  is 
completely  exploited  by  our  machinery.  It  takes  no  longer  to  respond  to 
’That  cars  are  tan?"  than  to  the  less  elliptical  "What  cars  have  color  tan?" 
The  following  blind  search  solves  "What  cars  are  tan 
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4.2.4.  Who  are  the  parents  of  a  tan  dog  owner? 


Note  that  this  query  is  ambiguous.  In  the  program  listing  below,  "(tan 
dog)  owner"  is  on  the  left  "tan  (dog  owner)’’  is  on  the  right  Code  common  to 
both  meanings  is  on  the  left.  It  would  be  up  to  the  natural  language  front 
end  to  determine  which  query  is  meant,  or  to  run  both  and  respond  with  both 
results. 


{First  set  MO  to  dogs) 

110  «-  (REL  =  #isa)  A  (ATYP  =  #dc£); 
Share  (MO); 


{Find  tan  dogs] 

I  Find  dog  owners  I 

Ml  *-  MO  it  (REL  -  #coior) 

A  (ATYP  «  /tan); 

Ml  -  AHC  &  (REL  =  /owns); 

Share(Hl); 

Share(Ml); 

{Find  owners  of  tan  dogs) 

|F  .nd  dog  owners  who  are  tan) 

M2  -  AMI  A  (REL  =/ owns). 

M2  -  Ml  A  (REL  *  /co'cr) 

A  (ATYP  =  /tan); 

Share  (M2); 

5hare(H2). 

{Find  parents  of  nodes  with  M2J 
M3  -  AM2  A  (REL  =  /parent); 
Print(M2). 


4.2.5.  Which  man  is  married  to  Jane? 

This  query  is  as  simple  to  implement  as  the  ones  before  it,  but  it  serves 
to  point  out  one  of  the  powerful  features  of  the  parallel  implementation.  A 
sequential  processor  evaluating  this  query  from  left  to  right  might  search 
thousands  of  men,  selecting  only  the  one  with  a  "married"  arc  to  "Jane".  A 
sequential  processor  evaluating  from  right  to  left,  on  the  other  hand,  starts 
from  Jane  and  checks  through  the  elements  in  the  (singleton)  set  of  nodes 
with  a  "married"  arc  connection  to  Jane,  finding  which  of  the  nodes  has  an 
"isa”  arc  to  "man".  The  processing  time  will  be  dramatically  affected  by  the 
order  of  processing.  The  parallel  implementation,  however,  takes  the  exact 


MO  -  (REL  =  #isa)  k  (ATYP  =  #car); 
SKARE(MO): 

Ml  -  MO  k  (ATYP  =  #tan); 
PRINT(Ul); 


This  search  is  blind  in  that  no  mention  is  made  of  what  arc  is  found  between 
"tan"  and  “car".  In  this  case  only  relation  "color"  was  possible,  but  consider 
the  query  "Which  Mew  York  salesmen  drive  corvettes?"  This  elliptical  phrase 
may  refer  to  salesmen  whose  sales  district  includes  New  York,  whose  home  is 
in  New  York  or  perhaps  whose  favorite  city  is  New  York.  Thus  a  method  is 
desired  which  returns  not  just  the  name  but  also  the  arc  used  to  make  the 
connection  The  response  might  be: 

New  York  xsales  district)  salesmen 
Joe 
Carl 

New  York  (borne)  salesmen 
Pete 

New  York  (favorite  city)  salesmen 
Ed 


A  mechanism  of  this  form  is  available  In  Thompson’s  POL  system  (Thompson 
[l9Sl]).  For  our  system  to  reply  in  this  form,  the  following  program  works: 

MO  *-  (REL  =  #job)  k  (ATYP  =  ^salesman); 

SKARE(MO); 

SO «-  0; 

f  SO  will  remain  0  in  salesmen  nodes  not  connected  to  New  York  nodes] 
Ml  -  MO  A  (ATYP  =  #New-York); 

IF  Ml  THEN  SO  REL: 

PRINT(SO): 


To  handle  this  situation  in  a  more  complete  manner,  sorting  should  be  used. 
This  extension  is  described  in  section  5.1. 
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same  time  in  either  case  as  demonstrated  in  the  side-by-side  comparison 
below: 


{ left  to  right  analysis  j 
{find  mer.j 

110  *-  (REL  =  #isa) 

4c  (A7YP  =  ^nan): 
SHARE(MO); 

{now  find  those  married  to  Jane  j 

111  *■  UC  4c  (REL  =  /married) 

4c  (A7YP  =  /Jane); 
PRINT(Ml); 


1  right  to  left  analysis  J 
{find  those  married  to  Jane] 

110  «-  (REL  =  /married)  4c  (A7YP  =  /Jane); 

SHARE(MC); 

(now  find  those  which  are  men{ 

Ml  «-  MC  4c  (REL  =  /ise) 

4c  (A7YP  =  /man); 

PRINT(Ml); 


The  parallel  method  is  independent  of  processing  order  and  the  size  of 
intermediate  sets;  this  is  one  of  the  most  significant  features  of  the  system 
and  guarantees  consistent  performance. 


4.2.6.  What  cars  are  tan? 

Although  humans  automatically  know  that  "tan"  is  a  color  and  thus  only 
color  arcs  are  of  interest  in  solving  this  query,  no  such  generalization  is  • 
made  by  our  query  system.  Instead,  e  search  will  be  performed  for  any  cars 
which  have  a  connection  to  "tan".  The  parallel  nature  of  the  search  is 
completely  exploited  by  our  machinery.  It  takes  no  longer  to  respond  to 
"What  cars  are  tan?"  than  to  the  less  elliptical  "What  cars  have  color  tan?" 
The  following  blind  search  solves  "What  cars  axe  tan?"; 

MO  -  (REL  =  #isa)  «c  (ATYP  =  #car); 

SKARE(M0); 

Ml  -  MO  4c  (ATYP  =  #tan); 

PRINT(MI); 

This  search  is  blind  in  that  no  mention  is  made  of  what  arc  is  found  between 
“tan"  and  "car".  In  this  case  only  relation  "color"  was  possible,  but  consider 
the  query  "Which  Nru,  York  mlssmm  drive  corvettes?"  This  elliptical  phrase 
may  refer  to  salesmen  whose  sales  district  includes  New  York,  whose  heme  is 
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4J2JS.  Who  are  Joe'*  ancestors? 

Although  we  could  proceed,  much  as  we  have  so  far,  and  build  a 
program  which  will  solve  this  query,  it  is  far  better  to  consider  some  related 
queries.  For  instance,  consider  "Who  are  the  mercedes  owner's  ancestors?" 
How  many  times  do  we  need  to  follow  the  parent  arcs  up  the  family  tree?  We 
don’t  know  until  we  know  who  the  mercedes  owner  is.  But  it  is  clear  that  no 
matter  who  that  person  is,  we  want  to  follow  the  parent  arcs  until  there  are 
no  more.  In  many  instances  we  need  to  process  trees  of  information  like 
"ancestors".  We  say  that  the  "parent"  arcs  form  a  hierarchy.  There  is  also 
an  "isa”  hierarchy  which  has  four  levels,  "John"  -•  "man"  -•  "human"  -» 
"animal"  for  example.  The  next  section  will  introduce  a  framework  in  which 
queries  involving  hierarchies  may  be  handled  gracefully. 

There  are  many  other  queries  of  equal  and  higher  complexity  that  may 

* 

be  asked  of  the  family  data  base.  In  other  sections  of  this  paper  we  will 
revisit  this  data  base  «vnd  explore  it  further. 


4.3.  Kingdom  Data  Base:  A  Hierarchy 

There  are  over  700,000  species  of  animals  (Newman  [19B7]).  The  animal 
kingdom  is  divided  into  seven  phyla,  and  these  phyla  are  divided  into 
classes,  classes  into  orders,  and  orders  into  families.  Families  are  divided 
Into  genuses  and  finally  genuses  into  species.  At  each  level  of  this  enormous 
hierarchy  various  features  or  properties  distinguish  each  group.  For 
instance,  the  animal  kingdom  is  differentiated  from  the  plant  kingdom  by 
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power  of  locomotion,  nonphotosynthetic  metabolism  and  other  properties. 
Animals  of  the  order  perissodactyla  (which  includes  horses)  have  an  odd 
number  of  toes,  while  artiodactyla  (which  includes  deer)  have  an  even 
number  (Lane  [19S4]). 

If  we  wish  to  design  a  data  base  of  zoological  facts,  we  could  list  for 
each  species  all  of  its  attributes.  This  is  most  inefficient,  however,  since  we 
would  be  ignoring  the  power  of  the  hierarchy  and  data  would  be  repeated 
many  times.  Instead,  let  us  attach  information  as  high  up  the  tree  as 
possible.  Since  '’animals  move"  we  will  say  this  once,  at  the  top  level,  instead 
©f  attaching  this  piece  of  information  to  each  species  (or,  worse  yet.  each 
animal).  1 fe  can  take  this  concept  one  step  further  and  include 
generalizations  which  are  "almost  al-ays"  true.  We  might  include  "birds  fly" 
in  our  data  base.  Then  it  will  be  nec  ssary  to  cancel  this  information  where 
it  is  incorrect  ("penguins  and  ostriches  don’t  fly"). 

Figure  4.2  shows  a  part  of  an  associative  network  for  this  information. 
Our  query  processor  will  accept  questions  such  as  ’That  animals  Tly  and  lay 
eggs?"  We  need  to  build  machinery  so  that  parrots  will  be  listed,  penguins 
will  not  be.  and  perhaps  flying,  fish  will  be. 

4J3.1.  Harking  a  Hierarchy 

Let  us  start  with  a  slightly  simpler  problem.  How  can  we  mark  all  of  the 
species  under  a  given  node  in  the  hierarchy?  This  method  will  handle 
queries  such  as  That  species  of  animals  are  vertebrates?”  Assume  that  the 
hierarchy  is  built  using  "isa"  arcs  up  the  tree:  ’’carnivore  ’isa’  mammal."  Also 
assume  that  relation  "level"  exists  which  determines  what  level  in  the 


hierarchy  this  node  is  at:  "the  ’level’  or  carnivore  is  order.”  Given  this 
information,  we  •write  the  following  program 


(MO  will  be  true  in  all  nodes  under  vertebrate) 

MO  *-  TYP  =  #  vertebrate; 

(Ml  will  hold  the  frontier  of  the  tree  we  are  marking) 

Ml  *  MO; 

WHILE  ANY  (Ml)  DO 

(M2  is  true  for  all  new  nodes  to  be  marked) 

M2  «-  AMI  k  (KEL  =  #isa); 

SHARE(M2); 

MO  -  MO  V  M2; 

(These  nodes  become  the  new  frontier  of  the  tree) 

Ml  •>  M2; 

END; 

(Now  set  M3  to  just  those  nodes  in  the  subtree  which  are  species) 
M3  *•  MO  It  (KEL  *  #level)  k  (ATYP  =  #species); 

Print(M3); 


Using  the  very  same  technique,  we  can  now  answer  the  query 
"ancestors  of  Joe"  from  the  family  data  base  (section  4.2.5).  The  changes 
necessary  are:  the  starting  node  MO  should  be  set  to  TYP  =  jjfJoe;  M2  should 
be  assigned  REL  =  #parent-of  instead  of  REL  =  # isa;  at  the  end  we  will  set  M3 
if  MO  and  (TYP  ¥  #Joe),  since  Joe  is  generally  not  considered  to  be  an 
ancestor  of  himself. 

We  can  formalize  the  marking  of  a  tree  by  defining  a  procedure 
MARKALL  This  procedure  accepts  two  parameters,  a  mark  bit  and  a 
relation  number.  On  input  the  mark  bit  will  be  true  for  the  starting  values 
in  the  tree  (''vertebrate"  or  "Joe”);  on  output  the  mark  bit  will  be  true  in  the 
entire  subtree  built  of  the  relation  number.  The  relation  number  thus  tells 
which  hierarchy  we  are  trying  to  use  and  in  which  direction.  The  parent*of 
hierarchy  may  be  used  either  "up”  for  ancestors  or  "down"  for  descendants. 
We  may  rewrite  our  program  for  "What  species  of  animals  are  vertebrates" 
as: 

MO  4-  TYP  =  # vertebrate, 

MARKALL(MO.#isa); 

Ml  *■  MO  k  (REL  =  # level)  k  (ATYP  a  #species); 

Print(Ml); 

A  program  for  "ancestors  of  Joe"  is  now: 

MO  TYP  =  #Joe; 

MARKALL(MO.#parent-of); 

Ml  -  MO  k  (NOT  (TYP  =  #Joe)); 

Print(Ml); 
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4.3.2.  Property  Inheritance 


As  an  extension  of  MARXALL,  tbe  INHERIT  procedure  passes  a  property 
down  a  tree  as  opposed  to  just  marking  a  tree.  INHERIT  is  called  by: 

INHERIT  (WORD.RELNAME); 

Tbe  code  for  INHERIT  is  slightly  more  complicated  than  MARKALL  since  it  is 
important  that  we  block  information  from  moving  down  tbe  tree  if  a  value  is 
already  assigned  to  that  subtree  (Fahlman  [1991]).  For  example,  a  relation 
Tly"  might  have  values  "Yes"  and  "No"  and  we  want  "birds  fly  yes”  but 
"penguins  fly  no”.  If  we  simply  used  MARKALL  to  start  from  'birds  Dy  yes", 
penguins  would  inherit  tbe  trait  from  birds.  (In  a  sense  we  have  a  three¬ 
valued  logic.  Some  nodes  are  marked  "Yes",  some  "No"  but  most  are  marked 
"whatever  1  inherit  from  above.")  Assuming  parameter  WORD  is  a  word  set  to 
the  starting  values  and  RELNAME  is  some  relation,  we  can  implement 
INHERIT  as  follows. 


!We  will  use  MAX  on  our  shares,  though  in  general) 
there  will  be  only  one  non-zero  value) 

SHARE(WQRD.MAX); 

(SO  bolds  tbe  frontier  of  tbe  tree) 

SO  «-  WORD; 

WHILE  (MAX(SO)  >  0)  DO  . 

! There  is  some  value  in  tbe  frontier) 

MO  marks  nodes  to  be  added  to  the  frontier) 

MO  «-  (ASO  >  0)  It  (REL  =  RELNAME)  k  (WORD  =  0); 

(If  MO  is  on.  transfer  tbe  value  of  tbe  connected  node) 
SI  -  0; 

IF  MO  THEN  SI  -  ASO; 

SHARE(S1.MAX); 

(Ml  marks  nodes  which  have  obtained  WORD  values) 

IF  Ml  THEN  WORD  -  SI; 

SO  *■  Si;  (Tbe  new  frontier) 

END; 


With  MARKALL  and  INHERIT  in  place  we  can  handle  queries  such  as: 
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What  animals  fly  and  lay  eggs? 

Which  vertebrates  have  tails? 

Are  there  any  birds  that  swim? 

What  is  the  order  of  penguins? 

To  what  category  do  both  ostriches  and  horses  belong? 

4.3.3  Tuning  Results  for  HARXALL  and  INHERIT 

An  instruction  count  for  MARXALL  end  INHERIT  is  dependent  on  the 
number  of  levels  in  the  hierarchy.  MARXALL  will  take  approximately  135/i.s 
per  level  of  the  hierarchy,  most  of  that  time  being  the  cost  of  the  SHARE 
statement.  INHERIT  will  take  approximately  2.5ms  per  level,  most  of  that 
time  for  the  expensive  integer  SHARE  statement.  If  one  knows  that  there 
are  less  than  256  different  properties  of  this  type  (for  example,  colors)  and 
also  that  these  properties  have  been  assigned  numbers  such  that  the  final 
eight  bits  are  different  for  each  property,  then  INHERIT  may  be  used  on 
eight  bit  quantities  and  the  execution  time  is  only  1ms. 

4.4.  Timing  Comparisons  with  a  Sequential  Method 

In  order  to  determine  bow  successful  the  parallel  implementation  is,  a 
sequential  method  needs  to  be  developed  for  comparison.  One  feature  of 
any  method  for  comparison  is  that  it  should  be  possible  to  determine 
general  timing  results  easily.  The  method  described  below  has  this  feature 
and  is  also  reasonably  efficient. 

An  associative  network  is  based  on  a  set  of  arcs  which  describe  all  or 
the  interrelations  in  the  network.  An  arc  has  three  parts:  a  from-node,  a 
relation  and  a  to-node.  We  can  thus  think  of  an  associative  network  as  an 
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arc  table  witb  three  columns.  To  implement  the  queries  efficiently,  we  want 
fast  access  to  all  of  the  arcs  which  have  a  particular  value  in  a  particular 
column.  One  method  is  to  build  a  sorted  binary  tree  for  each  column.  A  leaf 
in  this  tree  is  a  linked  list  of  pointers  to  those  elements  of  the  table  with  a 
given  value  in  that  column.  Figure  4.3  shows  an  arc  table  end  a  sample  tree 
necessary  for  access  to  the  to-node  column. 

Let  us  assume  that  our  sequential  machine  can  execute  a  basic 
Operation  (numerical  or  boolean  comparison,  pointer  dereference  or 
assignment)  in  250ns,  the  same  cycle  time  as  the  BVU  Given  information 
about  the  data  base,  we  can  determine  the  time  to  execute  a  query  using 


binary 
for  to— nod* 


Figure  4.3  Bata  Structures  for  Sequential  Method 
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•  100,000  animals  in  2000  species 

•  40%  birds.  30%  mammals.  30%  others 

•  500,000  arcs,  125.000  nodes 

Now  let  us  look  at  a  sample  query.  Consider  "Which  birds  have  red 
wings?”  For  the  sequential  method,  the  final  step  will  take  most  of  the  time, 
wherein  40,000  birds  are  input  and  a  test  will  be  made  which  requires  three 
comparisons  (relation  =  "wing-color",  to-node  a  "red"  or  inherited  color  = 
"red”)-  Even  though  we  have  used  the  hierarchy,  at  the  last  stage  all  birds 
must  be  checked  since  there  may  be  cancellations  and  exceptions  (perhaps 
a  bluebird  flew  into  some  red  paint!).  Using  the  formula  above  with  nt  = 
40,000,  b  =  4  (500,000  /  125,000),  c  =  3,  and  nc  =  1000  (an  approximate),  the 
timing  result  for  this  Anal  step  is  630ms. 

The  parallel  implementation  must  inherit  wing  color  to  each  bird. 
Assuming  there  are  four  levels  of  hierarchy  between  ''bird’’  and  each  specific 
bird,  the  total  time  to  execute  the  IKHERJT  statement,  according  to  section 
4.3.3,  will  be  10ms,  a  sixty-fold  speed-up  over  the  sequential  method.  -If  we 
use  the  method  suggested  in  that  section  and  assume  no  more  than  256 
colors,  the  run  time  will  be  only  4  ms,  a  150-fold  speed-up.  Finally,  if  wing- 
color  is  only  stored  at  the  individual  bird  level,  we  can  use  UARKALL  to  turn 
on  the  birds  and  then  only  need  a  single  integer  command  to  find  those 
birds  with  red  wings,  liming  for  this  method  is  550/is,  which  is  a  thousand¬ 
fold  speed-up  over  the  sequential  method. 


CHAPTER  5 


Numerical  Data 


In  Thompson's  POL  natural  language  system,  there  are  "attributes''  and 
"number  attributes"  (Thompson  [1982]).  These  correspond  to  arcs  that 
point  to  nodes  and  arcs  that  point  to  numbers  respectively.  POL  has 
distinct  syntax  and  semantics  for  these  two  cases.  There  are  a  number  of 
reasons  to  make  distinctions  between  numeric  and  non-numeric  data. 


(1)  Attributes  may  be  chained,  one  after  another,  whereas  number 
attributes  may  not.  Compare  "the  boss  of  the  boss  of  John"  and  "the 
salary  of  the  salary  of  John." 

(2)  Number  attributes  may  have  comparators  applied  to  them  whereas 
attributes  may  not.  An  example  is  the  query'  "Which  employees  of  John 
have  salaries  greater  than  John's." 

(3)  Number  attributes  may  have  statistical  and  numerical  functions  applied 
to  them  whereas  attributes  may  not.  Consider  "What  is  the  average 
aalary  of  female  engineers." 

(4)  Attributes,  when  unqualified,  refer  to  their  range  and  can  be  used  as 
auch  in  a  query.  For  instance  "bosses”  means  "bosses  of  anyone"  and 
the  query  "Which  bosses  are  overweight?"  is  understandable.  “Salaries" 
might  be  thought  of  in  the  same  light  (as  a  group  of  numbers,  in  this 
case},  but  this  only  leads  to  sensible  queries  when  a  statistical  function 
is  applied:  "What  is  the  largest  salary?" 

In  our  system,  we  will  find  that  new  methods  are  necessary  for 

numerical  calculations.  In  this  chapter  we  will  explore  these  methods. 
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S.l.  Representing  Number  Attribute* 

lo  our  stated  method  for  implementing  associative  networks  on  the 
SW,  we  would  require  a  processor  to  be  allocated  to  "$20,000"  if  there  is  a 
fact  "John’s  salary  is  $20,000."  The  rationale  for  separating  "John1'  and 
"$20,000"  into  separate  PEs  was  so  that  the  SHAPE  algorithm  would  work  on 
each.  It  is  inconceivable,  however,  that  e  SHAPE  is  needed  for  "$20,000"  or 
any  other  number.  Instead  we  win  allocate  a  single  PE  to  this  fact  and  add  a 
VAL  field  in  the  processors  to  bold  the  value  to  which  this  arc  points.  Now  a 
query  like  "Who  has  $10,000  as  salary?"  may  be  evaluated  by: 

MO  -  (REL  =  #salary)  &  (VAL  *  $10,000); 

Print(MO), 

Compare  this  to  the  non-numeric  query  of  the  same  form,  "Who  has  John  as 
parent?”  which  is  solved  in  section  4.2.2.  In  this  query  the  value  "John”  is 
stored  in  ATYP.  the  type  field  in  the  associated  processor.  For  numeric 
queries,  we  store  this  number  directly  in  the  processor.  Thus,  numeric  facts 
require  only  a  single  processor. 

8J2.  Numerical  Procedures 

It  was  noted  earlier  that  procedure  SHAPE  could  be  executed  on  words 
nwing  any  of  the  operations  ION,  VAX  or  ADD.  These  yield  much  of  the 
necessary  numerical  power.  MIN,  VAX  and  ADD  may  also  be  used  as 
procedures  over  the  entire  machine.  In  this  case  they  are  similar  to  ANY, 
but  work  on  words.  Thus  VAX(Sl)  finds  the  maximum  value  of  Si  in  any  PE 
and  places  that  value  in  each  PE's  Si  word.  Further,  just  like  ANY,  VAX  can 
be  called  as  a  function  which  returns  this  value  to  be  used  in  an  IF  or  WHILE 
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statement  or  to  be  PRIXTed.  Tbe  timing  result  for  MIN  and  MAX  is  20/js.  ADD 
takes  30iis  due  to  tbe  carry  propagation.  SHAKE  with  MIN  or  MAX  takes 
2.4ms,  with  ADD  3.6ms. 

A  peculiar  feature  of  tbe  system  is  that  MAX  (Si)  takes  significantly  less 
time  than  SHARE(Sl.MAX).  even  though  tbe  number  of  maximums  is  tbe 
same.  MAX  is  homogenous  (all  values  may  be  MAXed  in  any  order),  while 
SHARE  with  MAX  requires  that  numbers  be  MAXed  with  specific  others.  On 
parallel  processors,  homogenous  processes  tend  to  be  faster. 

SD.  Numerical  Queries 

In  a  previous  example  we  saw  a  simple  numerical  comparison.  Another 
query  of  importance  is  "Whose  salary  is  greater  than  John's?"  We  can  use 
MAX  to  replicate  "John's  salary"  into  all  of  the  PEs.  Tbe  following  program 
implements  the  query. 

MO  *■  (REL  =  ^salary)  Ac  (7YP  =  #John); 

SO  -  0; 

IF  MO  THEN  SO  -  VAJU 

{Exactly  one  processor  has  a  non-zero  value  for  SO} 

MAX(SO); 

{Now  all  SO’s  have  that  value] 

Ml  -  {REL  *  fsalary)  &  (VAL  >  SO); 

PRlNT(Ml); 


MIN  may  be  used  to  answer  "Who  has  the  smallest  salary?"  Note  tbe  care 


> 


necessary  in  tbe  following  program  to  make  sure  only  people  with  salaries 
are  considered.  There  is  assumed  to  be  some  value  which  stands  for  infinity 

<-)• 


110  *■  (REL  =  fsalary); 

SO  «-  •»; 

F 110  THEN  SO  4-  VAL; 

{SO  has  non-infinite  values  only  in  REL  =  salary  processors) 
IdN(SO); 

{Now  SO  has  the  smallest  salary] 

1(1  -  MO  k  (VAL  s  SO); 

PRINT(Ml); 


A  variety  of  queries  require  that  the  system  to  be  able  to  count. 
Consider  the  query  "How  many  employees  does  each  boss  have?"  SHARE  with 
operation  ADD  will  suffice.  We  will  have  1's  in  only  those  processors  which 
have  a  "boss"  relation  pointing  toward  them.  (If  “boss  of  John  is  Paul"  holds, 
some  *Taul“  processor  will  have  value  1.)  Adding  them  will  give  us  the 
correct  count  for  each  boss. 


MO  *•  (REL  =  -#boss); 
SO  0; 

F  MO  THEN  SO  4-  l; 

SHAR£(S0.ADD); 

PRINT(SO); 


To  handle  "Which  boss  has  the  most  employees?'  it  is  Decessary  to  add  the 
following  lines: 


Si  -  SO; 
MAX(Sl); 

Ml  -  (SO  =  SI); 
PRINT(Ml); 


A  variety  of  more  complex  numerical  queries  can  be  imagined.  Most  of 
them  involve  the  basic  ingredients  already  described,  with  perhaps  new 
procedures  for  other  basic  operations. 
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S.4.  A  Map  Data  Base 

Is  this  section  we  pursue  the  numerical  data  base  from  section  1.3.  The 
primary  arcs  in  the  system  are  "highway"  arcs  which  have  three  parts:  a 
highway  number,  a  distance  in  miles,  and  a  travel  time  in  minutes.  Figure 
5.1  shows  the  representation  of  part  of  a  time-distance  map  as  an 
associative  network.  Note  that  along  with  "highway"  arcs,  there  are  "state" 
arcs  which  give  the  state  associated  with  each  city.  Other  information  such 
as  population,  rest  stops  and  road  condition  could  also  be  included. 

This  data  base  can  handle  queries  such  as  "What  cities  are  in 
Maryland?"  and  "What  cities  on  highway  40  have  more  than  500,000  people?" 
but  our  primary  interest  in  this  data  base  is  to  calculate  trip  information.  A 
typical  query  might  be  “Kow  far  is  it  from  Baltimore  to  each  city  in 
Virginia?"  Much  as  INHERIT  works,  we  will  solve  this  by  starting  with  selected 
information  and  then  emanating  information  from  the  starting  points.  The 
frontier  of  this  growing  tree  will  be  those  cities  which  have  a  new  minimum 
walue.  Using  SHARE  with  operation  MIN.  the  routine  will  give  to  a  city  which 
Is  on  more  than  one  route  its  minimum  value.  We  call  this  routine  MINIMIZE 
for  obvious  reasons.  To  make  the  program  for  MINIMIZE  easier  to  read,  we 
will  use  variable  names  which  make  sense  and  then  "declare"  them  to  be 
words  or  bits.  We  will  also  take  a  few  liberties  with  the  language,  recognizing 
this  procedure  as  a  sketch  or  the  solution.  A  leading  "A"  is  still  used  to 
specify  the  associated  processor.  The  three  parameters  are:  1CNW0RD.  a 
word  which  is  already  set  to  the  Initial  values  and  will  be  returned  set  to  the 
final  values;  ENABLE,  a  precalculated  bit  which  is  on  in  all  processors  whose 
mrcs  the  procedure  is  allowed  to  use;  CALCWORD.  the  word  containing  the 
Increment  used  when  traversing  arcs,  will  usually  be  set  to  either  the 
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!CNIMIZE(Minword,Enable.Calcword); 

WORD:  Minword,  Calcword,  Currval,  Newval; 

BIT:  New.  Enable; 

BEGIN 

Currval  *•  •*. 

Newval  <-»; 

IF  (Minword  x  »)  THEN  Newval  *■  Minword; 

New  ♦-  (Newval  <  Currval); 

WHILE  (ANY (New))  DO 

IF  New  THEN  Currval  «-  Newval; 

IF  (New  A  AEnable)  THEN  Newval  «-  ACurrval  ■+  ACalcword; 
SHARE  (Newval.  MIN); 

New  *-  (Newval  <  Currval); 

END; 

Min  word  *■  Currval; 

END; 


We  can  use  this  procedure  to  calculate  the  distance  From  Baltimore  to 
eacb  city  in  Virginia  as  follows: 

MO  *-  REL  =  fhighway;  }  The  enable  bit  j 

(SO  will  be  set  to  zero  in  Baltimore  and  «  elsewhere) 

50  *■  *; 

Ml  «■  MO  &  (TYP  =  ^Baltimore); 

IF  Ml  THEN  SO  -  0; 

MIMMIZE(SO, MC, Distance); 

(We  now  have  the  distance  to  each  city,  so  we  need  to  isolate  Virginia) 

112  *■  (REL  =  #state)  A  (ATYP  =  ^Virginia); 

51  «-  0; 

IF  M2  THEN  Si  -  SO. 

Print(SO); 


SJB.  Timing  Considerations  for  the  Hap  Data  Baae 


To  estimate  the  run  time  of  this  problem,  we  will  make  the  following 
assumptions.  There  are  5500  cities  in  the  United  States  whose  population  is 
greeter  than  five  thousand  (lane  [1954]),  and  we  will  assume  that  4500 
•mailer  cities  which  lie  on  junctions  of  highways  will  be  added.  These  10,000 
cities  will  be  assumed  to  lay  in  a  100x100  grid,  each  city  with  highway 
connections  to  the  eight  surrounding  cities. 


44 


For  tbe  parallel  analysis  we  need  an  estimate  of  the  number  of  arcs  in 
the  longest  minimum  path.  We  will  use  200,  as  this  allows  connecting 
diagonal  cities  by  going  straight  horizontally  and  then  straight  vertically. 
The  main  loop  of  MINIMIZE  will  be  executed  200  times  and  the  cost  of  one 
execution  is  about  2.6ms  (due  primarily  to  the  integer  SHARE).  Total 
execution  time  will  be  0.52  seconds. 

Recall  from  section  4.4  that  we  define  A  to  be  the  total  number  of  arcs, 
to  to  be  tbe  average  branching  factor,  and  7C  to  be  the  number  of  nodes.  In 
our  case,  A  =  60,000,  b  a  8  and  N  =  10,000.  One  good  sequential  method  for 
this  problem  is  to  build  a  list  of  nodes  sorted  by  minimum  distance  and 
expand  the  minimum  distance  node  that  has  not  already  been  expanded. 
(This  method  is  better  than  Dijkstra's  algorithm  (Abo  [1974])  when 
Alog2(N)<N2.  in  this  case  1  million  <  100  million.)  Tbe  current  node  is 
visited  and  its  b  arcs  followed,  altering  the  position  in  tbe  sorted  list  of 
those  nodes  with  new  minimum  values.  The  expected  run  time  is: 

N  (t£  +  b(t„  +(4+1!)  x  Iog-(.K))) 

where  4  is  the  time  to  get  a  new  node's  arcs,  tp  is  the  time  to  process  each 
arc.  If  is  the  reinsert  cost  for  a  node  and  4  is  tbe  time  to  look  for  tbe  nerw 
position  for  a  node  in  the  sorted  list.  He  estimate  the  following  values:  t£  = 
2,  tp=  5.  4  =  3  end  4  =  4.  Under  these  assumptions,  the  sequential  method 
will  take  7.7  million  instructions  which  is  around  2  seconds  of  processing 
time. 

The  parallel  method  is  only  four  times  as  last  as  the  sequential  method. 
Why  don't  we  receive  better  improvement?  First,  less  than  one  sixth  of  the 
machine  is  being  used.  Second,  integer  operations  are  20  times  slower  on 
the  BVM.  Third,  tbe  SHARE  operation  takes  milliseconds  per  use.  Finally, 


the  parallel  machine  gains  the  most  when  the  branching  factor  is  high,  when 
graphs  are  "busby”.  In  the  given  example  the  branching  factor  of  eight 
significantly  limited  the  available  parallelism. 

Consider  the  following  more  favorable  problem.  Suppose  we  have  a 
completely  connected  graph  of  700  nodes,  thus  490.000  arcs.  Making  the 
same  assumptions  as  above  the  results  are:  the  parallel  method  runs  in 
75ms;  the  sequential  method  runs  in  9  seconds.  Now  the  speedup  is  100- 
fold.  (For  this  case,  however.  Dijkstra's  algorithm  will  run  in  around  1 
second  but  we  still  have  an  12-fold  increase.) 

It  is  conceded  that  the  constants  used  throughout  this  section  are 
rough.  Even  though  the  BVM  has  an  integer  speed  one  twentieth  that  of  the 
sequential  machine  to  which  it  is  compared,  the  BVM  still  obtains 
performance  improvements  over  the  sequential  method.  It  is  apparent, 
however,  that  the  precise  form  and  size  of  the  problem  causes  significant 
changes  in  the  improvement  level. 


graphs  are  ''bushy”.  In  the  given  example  the  branching  factor  of  eight 
significantly  limited  the  available  parallelism. 

Consider  the  following  more  favorable  problem.  Suppose  we  have  a 
completely  connected  graph  of  700  nodes,  thus  490,000  arcs.  Making  the 
same  assumptions  as  above  the  results  are:  the  parallel  method  runs  in 
75ms;  the  sequential  method  runs  in  9  seconds.  Now  the  speedup  is  100-fold. 

For  this  problem,  however,  Dijkstra's  algorithm  will  run  in  around  1 
second  but  we  still  have  an  12-fold  increase.  Alternative  methods  will  also 
improve  the  parallel  timing  result  Consider,  for  example,  the  shortest  path 
method  used  in  Aho  [1974];  e  connection  matrix  is  manipulated  to  determine 
shortest  paths.  A  parallel  version  of  this  method  does  not  rely  on  Share  and 
should  improve  our  results  since  it  takes  advantage  of  greater  parallelism. 

It  is  conceded  that  the  constants  used  throughout  this  section  are 
rough.  Even  though  the  BVM  has  an  integer  speed  one  twentieth  that  of  the 
sequential  machine  to  which  it  is  compared,  the  BVM  still  obtains 
performance  improvements  over  the  sequential  method.  It  is  apparent, 
however,  that  the  precise  form  of  the  problem  and  its  size  in  comparison  to 
the  number  of  processors  available  to  solve  the  problem  cause  significant 
changes  in  the  level  of  improvement  achieved  by  a  parallel  processor. 


CHAPTER  6 


Extensions  And  limitations 


In  this  chapter  we  will  explore  the  boundaries  of  our  system.  We  shall 
look  at  tasks  which  are  very  difficult  using  this  framework.  Our  results  will 
show  that  the  method  is  general  enough  to  handle  most  of  the  problems.  We 
will  also  investigate  extensions  which  will  allow  representation  of  more 
complex  objects. 


8.1.  Tabular  Output 

The  response  to  a  variety  of  queries  is  a  table  of  results.  Consider  the 
query  "What  is  the  name.  age.  height  and  sex  of  each  engineer?"  which  might 
produce  e  table  like  the  one  below. 

Engineers 

MIM _ 1U _ height  eex 


John 

31 

72 

■ale 

Jill 

26 

84 

Female 

Peter 

47 

74 

■ale 

Kathy 

24 

89 

Female 

Our  system  can  implement  this  query  by  PRINTing  one  column  of 
information  at  a  time.  The  following  program  is  e  possibility. 

Ml  -  (PEL  w  #job)  It  {ATYP  *  # engineer); 

SHARE(Ml); 

PRlNT(Ml);  (Prints  the  names  of  engineers) 

M2 -Ml  k  (REL  =  #age); 

(  The  age  processor  for  each  engineer  has  U2  on  j 
SO  -  0; 

IF  MS  THEN  SO  -  VAL; 


PRJNT(SO);  {Prints  the  ages] 

M2  «-  Ml  &  (REL  =  ^height); 

}  The  height  processor  for  each  engineer  b&s  M2  on  ] 

SO  «-  0; 

IF  M2  THEN  SO  -  VAL; 

PR3NT(S0);  {Prints  the  heights] 

M2  *•  Ml  tc  (REL  =  #sez); 

{ The  processor  connected  to  the  sex  of  each  engineer  has  M2  on  ] 
SO  «-  0; 

IF  M2  THEN  SO  *•  ATYP;  {sex  is  an  attribute,  net  number  attribute] 
PRINT{S0);  {Prints  the  sexes] 


Another  type  of  tabular  output  is  generated  in  response  to  ’’List  the 
children  of  each  child  of  John.”  The  table  might  look  like: 


At  first  it  appears  that  we  may  have  to  use  a  sequential  technique.  But 
there  is  an  alternative.  If  we  have  a  SORT  routine  available  we  can  use  it  to 
sort  pairs  of  names.  If  we  sort  by  column  one  value,  all  or  the  information 
will  be  grouped  appropriately.  A  program  like  the  following  will  work: 

MO  *■  (REL  =  -#parent-of); 

SO  «-0; 

IF  MO  THEN  SO  -  ATYP; 

SORT(SO); 

PKINTSORT(SQ.VAL);1 


Were  there  more  than  two  levels  in  the  clause  we  would  no  longer  be 
table  to  answer  the  query  in  parallel.  To  find  "each  son  of  each  daughter  of 
each  son  of  John"  requires  using  some  sequential  step.  In  relational 
database  terms,  our  system  cannot  compute  a  cross-product  of  relations 
Without  resorting  to  sequential  processing.  Our  system  can,  however,  handle 


*7be  vtaadard  PRDC  procedure  wffl  not  work  Mace  it  urjaei  e  Magic  value  per  node 
PHDJT50RT,  we  anal  My  prist*  sorted  information  tad  wi2  allow  us  to  pita*,  as  maaj  columns 
as  desired  (in  thM  example,  two). 


PRINT(SO);  {Prints  the  ages] 

M2  «-  Ml  k  (REL  =  #heigbt); 

{  Ihe  height  processor  for  each  engineer  has  M2  on  ] 

SO  -  fi, 

IF  M2  THEN  SO  -  VAL; 

PRINT(SO);  {Prints  the  heights} 

M2- Ml*  (REL  =  #s  ex). 

{ Hie  processor  connected  to  the  sex  of  each  engineer  has  M2  on  j 
SO  -  0; 

IF  M2  THEN  SO  *-  ATYP;  {sex  is  an  attribute,  not  number  attribute] 
PRINT(SO).  {Prints  the  sexes] 


Another  type  of  tabular  output  is  generated  in  response  to  'list  the 
children  of  each  child  of  John."  The  table  might  look  like: 


child  of  lr.hr-  child  of  child  of  John 

Jack  Joan 

Jake 

Jill  Joe 


At  first  it  appears  that  we  may  have  to  use  a  sequential  technique.  But 
there  is  an  alternative.  If  we  have  a  SORT  routine  available  we  can  use  it  to 
sort  pairs  of  names.  If  we  sort  by  column  one  value,  all  of  the  information 
will  be  grouped  appropriately.  A  program  like  the  following  will  work: 

MO  «-  (REL  =  -fparent-of): 

SO  -  0; 

IF  MO  THEN  SO  -  ATYP; 

S0RT(S0); 

PRINTSORT(SO.VAL);1 


More  than  two  columns  might  be  necessary  in  a  query  such  as  "Who  are 
the  contact  people  for  the  largest  customer  of  each  salesman  in  each  region 
of  the  USA?"  The  result  might  be: 


*The  standard  P2DC  procedure  will  act  work  since  it  assumes  a  single  value  per  node. 
PBDCSORT,  we  shall  my,  prats  sorted  Information  and  wiS  allow  m  to  print  aa  many  columns  as 
desired  (in  this  rxarrpie,  two). 
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all  of  the  other  primitives  of  the  relational  algebra  (Date  [1982],  UUroan 
{1932]).  The  only  reason  we  were  able  to  handle  the  previous  query  is  due  to 
its  simplicity.  Of  course  sequential  methods  would  work  (stepping  through 
each  son  of  John)  but  in  the  cross-product  case,  and  only  in  this  case,  the 
required  processing  time  is  a  function  of  the  size  of  the  class  being 
processed. 


6.2.  Molecules:  Complex  Object  Representation 


Consider  a  fact  such  as  "The  Raru  carries  coal  from  Portland  to  Tokyo.” 
In  our  current  scheme,  it  is  necessary  to  divide  this  fact  into  three  separate 
pieces  of  information:  "cargo  of  Raru  is  coal";  "departure-point  of  Raru  is 
Portland";  and  "destination  of  Raru  is  Tokyo."  This  division  is  not 
acceptable,  however,  since  we  have  lost  the  ewifejrf  of  the  individual  pieces 
of  information.  Consider  the  following  example.  "John  hit  Joe  in  the  Back" 
and  "Pete  hit  Joe  in  the  stomach"  yield  the  four  pieces  ”Jo_.i  hit  Joe",  "Joe 
was  hit  in  the  back",  'Pete  hit  Joe"  and  "Joe  was  hit  in  the  stomach."  Now  it 
is  not  at  all  clear  that  the  correct  response  to  "Did  Pete  fait  Joe  in  the 
back?"  is  "No."  Nilsson  [i960]  gives  a  method  of  changing  any  n~ary  relation 
into  a  set  of  binary  relations  without  loss.  There  are  several  reasons  we  will 
choose  another  method. 

•  Nilsson’s  method  adds  a  central  node  to  which  each  piece  of  information 
is  attached.  This  method  adds  an  unnecessary  node  type  for  every 
complex  fact  in  the  system. 

•  For  both  theoretical  and  efficiency  reasons  we  would  like  pieces  of 
information  which  are  tightly  coupled  to  be  equally  tightly  coupled  in  the 
representation.  This  minimizes  the  "semantic  distance"  of  the 
information  (Sows  [1964]). 

•  There  is  another  method  which  uses  the  BVR  efficiently  and  precisely 
represents  the  facts. 
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Fred  KTI  Pete 

West  George  Bank  of  America  Ellen 

Ralph 


One  can  extend  the  sorting  technique  to  sort  n-tuples  of  the  necessary 
length  at  a  speed  cost  linear  in  the  size  of  the  n-tuple.  Queries  of  this  sort 
«re  computing  a  cross-product  of  relations  in  the  machine,  and  this  could 
easily  overflow  the  available  number  of  processors.  In  the  example  above, 
the  word  "largest"  served  to  reduce  dramatically  the  number  of  n-tuples 
being  considered.  If  we  use  this  sorting  technique  we  might  need  to  monitor 
the  size  of  intermediate  structures  to  avoid  overflows.  Ridding  ourselves  of 
such  monitors,  however,  is  one  of  the  positive  features  of  the  system  in  all 
other  situations.  Thus  we  have  reached  one  of  the  limits  of  the  system. 


6.2.  Molecules:  Complex  Object  Representation 

Consider  a  fact  such  as  'The  Raru  carries  coal  from  Portland  to  Tokyo.” 
In  our  current  scheme,  it  is  necessary  to  divide  this  fact  into  three  separate 
pieces  of  information:  "cargo  of  Raru  is  coal”;  "departure-point  of  Raru  is 
Portland”;  and  "destination  of  Ram  is  Tokyo.”  This  division  is  not  acceptable, 
however,  since  we  have  lost  the  context  of  the  individual  pieces  of 
information.  Consider  the  following  example.  "John  hit  Joe  in  the  back”  and 
"Pete  hit  Joe  in  the  stomach"  yield  the  four  pieces  "John  hit  Joe",  "Joe  was  hit 
in  the  back",  "Pete  hit  Joe”  and  "Joe  was  hit  in  the  stomach."  Now  it  is  not  at 
•11  clear  that  the  correct  response  to  "Did  Pete  hit  Joe  in  the  back?"  is  "No." 
Nilsson  [i960]  gives  a  method  of  changing  any  n-ary  relation  into  a  set  of 
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8.3.  Some  Practical  Questions 

Let  us  deal  with  some  practical  issues.  First,  bow  expensive  is  this 
implementation?  How  much  does  a  BVM  cost  compared  to  a  sequential 
machine?  Being  so  simple,  each  PE  in  the  BVM  takes  “no  more  silicon  area 
than  some  512  bits  of  memory"  (Wagner  [19S3]).  Since  each  PE  is  given 
around  200  bits  of  local  memory,  the  BVM  takes  the  silicon  area  of  around 
700  million  bits  instead  of  200  million  bits.  Thus  the  cost  of  the  BVM  is  no 
more  than  three  times  the  cost  of  memory  alone  for  a  sequential  machine 
with  an  equivalent  amount  of  memory. 

Yhat  sort  of  general  improvement  does  one  expect  over  a  sequential 
machine?  Ye  have  looked  at  timing  comparisons  in  section  4.4.  What  we 
have  found  can  be  summarized  as  follows.  One  can  think  of  processing  a 
query  as  processing  one  set  of  nodes  after  another  until  a  final  set  is  found. 
If  there  are  k  sets  of  nodes,  the  average  number  of  nodes  in  a  set  is  n.  and  b 
oew  nodes  must  be  checked  from  a  given  node,  the  sequential  machine  will 
take  time  proportional  to  kxbxn,  whereas  the  parallel  method  will  take  time 
proportional  to  k.  The  constant  tor  the  parallel  method  is  quite  large, 
•round  120  microseconds  for  selection  operations  (boolean)  and  around  2.5 
milliseconds  for  inheritance  operations  (integer).  For  large  enough  queries, 
the  parallel  method  will  win;  further,  the  parallel  method  gives  results  which 
•re  independent  on  the  number  of  nodes  to  be  processed. 

A  final  question  is  how  transportable  is  Lbe  method  described  in  this 
paper?  'Will  it  only  work  on  the  BVM?  The  limitation  of  this  system  is  the 
•bility  to  implement  the  SHARE  algorithm  on  a  given  machine.  The  only 
requirement  for  implementation  of  this  algorithm  is  that  the 
interconnection  pattern  be  one  of  those  which  is  equivalent  to  the  binary 
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Tfae  method  we  suggest  is  called  molecules  because  we  will  use  hardware 
links  to  chain  together  all  of  the  pieces  of  information  which  make  up  a  fact. 
Again  consider  "The  Maru  carries  coal  from  Portland  to  Tokyo.”  We  may 
choose  to  connect  ’*coal''  to  ”Maru”  in  the  standard  way;  a  processor  is 
assigned  to  "Maru”  and  its  lateral  is  assigned  to  "coal".  with  the  link  labeled 
’’cargo”.  Now  let’s  assign  to  the  processor  which  is  the  predecessor  of  the 
"Maru”  processor  the  value  "Portland”  and  label  the  predecessor  arc 
"departure-point".  Further,  we  assign  to  the  successor  neighbor  of  the 
"Maru”  processor  the  value  "Tokyo”  and  label  the  successor  arc 
"destination”.  We  thus  have 


and  all  the  links  in  the  above  diagram  are  in  hardware.  Now  a  query  such  as 
"who  carries  coal  to  Tokyo”  requires  no  SHARE  operations. 

Although  we  shall  leave  molecules  as  a  possible  extension,  one  point  is 
worth  mentioning.  If  "destination”  is  found  via  a  successor  link  in  this 
molecule,  it  should  always  be  found  via  the  successor  link  of  every  molecule 
(and  single  connection)  in  which  it  is  used.  Otherwise  all  "match”  timings 
will  increase  by  a  factor  of  three,  as  the  system  will  have  to  search  the  three 
arcs  for  each  processor. 


n-cube.  in  that  one  can  emulate  the  other  with  only  a  constant  delay. 
Besides  for  the  mesh,  most  interconnection  patterns  are  equivalent  to  the 
binary  n-cube;  these  include  the  important  shuffle-exchange.  Benes  and 
omega  patterns  (Feng  [1981]).  The  method  described  in  this  paper  then, 
although  designed  for  the  BVM,  may  be  used  on  a  number  of  other  possible 
machine  configurations. 
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6.4.  Conclusion 

This  paper  has  described  a  parallel  implementation  of  associative 
networks.  The  BVM,  a  parallel  computer  with  one  million  processors,  is  used 
to  obtain  speedups  over  a  "good"  sequential  method  of  up  to  three  orders  of 
magnitude.  The  timing  results  are  "smooth",  depending  only  on  the 
complexity  of  the  query,  not  the  size  of  the  classes  being  processed.  The 
knowledge  representation  is  elegant  in  its  division  of  information  to  the 
most  atomic  level.  Important  concepts  from  the  field  of  semantic  networks, 
such  as  property  inheritance  and  cancellation,  have  been  shown  to  be 
successfully  bandied  by  the  system.  This  paper  has  described  in  detail  how 
to  build  an  associative  network  based  querying  system  which  embodies  the 
principle  "forget  about  trying  to  avoid  or  minimize  the  deductive  search, 
and  simply  do  it.  employing  a  rather  extreme  form  of  parallelism  to  get  the 
job  done  quickly"  (Fahlman  [1978]). 


APPENDIX  A 


The  SHARE  Algorithm 


To  implement  the  share  algorithm  discussed  in  the  text  requires 
developing  a  mapping  which  concentrates  the  information  for  each  node  of 
the  associative  network  into  a  single  processor  then  returns  the 
concentrated  values  to  each  original  processor.  The  mapping  for 
concentrating  may  be  used  in  reverse  to  disseminate  the  concentrated 
values,  thus  the  proofs  below  develop  only  the  concentrating  mapping.  The 
proofs  determine  constraints  on  the  time  complexity  necessary  to  reorder 
the  information  according  to  this  mapping.  The  binary  n*cube 
interconnection  will  be  used  in  the  proofs  and  then  a  constant-time  method 
will  be  described  which  emulates  the  binary  n*cube  on  the  BVM. 

• 

A-l  Definitions 

JV  equals  Z"  is  the  number  of  PEs  in  the  parallel  computer.  The  PEs  are 
numbered  0,1,...  N-l.  Each  PE  is  assumed  to  hold  a  single  value  of  interest. 

A  bit  i  relationship  is  an  interconnection  of  PEs  which  pairs  up  PEs 
differing  only  in  the  ith  bit  of  their  PE  number.  The  ’’larger*'  PE  is  the  one 
with  the  bit  on  (it  has  the  larger  PE  number);  the  ''smaller’'  PE  is  the  one 
with  the  bit  off.  We  apply  e  bit  i  relationship  by  selecting  for  each  pair  of 
PEs  one  of  tbe  following  four  operations: 


STAY:  each  PE  keeps  its  original  value 

CROSS:  the  PEs  swap  values 

ORUP:  the  larger  PE  is  assigned  the  value  of  the  OR  of  the  two 

■values;  the  smaller  PE  has  undefined  value. 

ORDOWN:  the  smaller  PE  is  assigned  the  value  of  the  OR  of  the  two 
■values;  the  larger  PE  has  undefined  value. 

The  operations  which  may  be  applied  to  the  PEs  can  be  pictured  as 
switches  (figure  Al).  The  OR  operations  are  used  on  Boolean  values,  which 
are  our  primary'  interest.  (The  operations  ADD  or  MAX/MIN  might  be 
considered  for  integer  or  floating  point  values.  Tbe  actual  operation  chosen 
does  not  affect  the  analysis.) 


A  general  mapping  assigns  to  each  input  PE  an  output  PE.  The  mapping 
is  said  to  be  applied  or  implemented  when  the  vaiues  are  moved  from  their 
input  PE  to  the  assigned  output  PE.  If  more  than  one  input  PE  has  the  same 
output  PE.  tbe  values  of  these  PEs  will  be  ORed  together  before  they  reach 
the  output  PE. 

A  permutaiion  is  a  one-to-one  mapping:  each  input  PE  is  mapped  to  e 
unique  output  PE.  For  implementing  a  permutation,  operations  ORUP  and 


STAY  CROSS  ORUP  OROOWN 

Figure  Al:  The  four  operations,  pictured  as  switches 
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ORDOWN  are  not  necessary. 

A  binary  n-cube  is  a  parallel  computer  consisting  of  a  set  of  N  PEs. 
Each  PE  has  n  direct  (hardware)  connections  to  those  PEs  with  which  it 
shares  a  bit  i  relationship,  for  each  i  less  than  n.  In  a  cube  with  n=3  (Xi=8), 
PE  5  (binary  101)  has  connections  to  PE  4  (100),  PE  7  (ill)  and  PE  1  (001). 
PE  2  has  connections  to  PEs  3,  0  and  6. 

A  state  of  the  binary  n-cube  is  a  list  of  values  assigned  to  the  PEs  at  a 
given  moment 

A  sweep  is  a  set  of  n  states  in  which  going  from  state  j  to  state  j+1  is 
achieved  by  applying  a  bit  i  relationship,  for  some  i.  Each  value  of  i  from  0 
to  n-1  appears  once  within  a  sweep. 

Ascend  is  a  sweep  with  the  bit  i  relationships  applied  in  order:  0.1, ...n-1. 

Descend  is  a  sweep  with  the  bit  i  relationships  applied  in  reverse  order: 
n-1.  n-2,...  0. 

A-2  Theorems  for  Personations  and  Mappings 

Theorem  1:  A  single  sweep  is  not  sufficient  to  implement  all  permutations. 

Proof:  There  are  M!  permutations  of  X  items.  Since  STAY  and  CROSS  are  the 
only  operations  which  may  be  applied  to  each  pair  in  a  bit  i  relationship  of  a 
permutation,  each  bit  i  relationship  of  a  sweep  allows  2^2  possible  switch 
settings.  Further,  there  are  n  states  in  a  sweep.  Thus,  a  sweep  can  only 
describe  combinations.  But  this  equals  N*'*  smce  n  is  logjCN).  In 

other  words,  there  are  only  VFP*  possible  permutations  that  the  sweep  can 


56 


describe.  N!,  however,  has  asymptotic  value  (N/e)K  and  is  larger  than  y/J!* 
for  all  N>2.  Thus,  a  single  sweep  may  not  implement  ell  general 
permutations. 


Theorem  2:  An  ascend  followed  by  a  descend  is  not  sufficient  to  implement 
all  mappings. 

Proof:  This  proof  develops  a  mapping  which  cannot  be  implemented  for  the 
case  N=B.  The  mapping  that  provides  the  counter-example  is 

Input  PE:  01234567 
Output  PE:  0  1  0  2  1  2  3  3 

This  means  that  PE  0  sends  its  value  to  itself,  so  does  PE  1.  but  PE  2  sends 
its  value  to  PE  0  as  well.  Thus,  at  some  time  in  the  process,  the  values  from 
PE  0  and  PE  2  must  be  ORed  together.  Figure  A2  shows  the  switches  for  an 
ascend-descend  pair  which  we  claim  cannot  implement  this  permutation. 
Note  that  between  the  ascend  and  descend  there  would  be  two  bit  n-1 
relationships.  Since  these  compare  the  same  pieces  of  information  we  will 
remove  one  of  the  two  redundant  steps.  The  state  of  the  system  over  time  is 
described  by  its  initial  values  and  the  settings  of  the  switches  in  each  phase 
from  left  to  right.  To  choose  a  particular  mapping,  one  needs  to  assign  to 
each  switch  one  of  the  four  operations.  Our  claim  is  that  no  such 
assignment  will  work. 

From  figure  A2,  alter  the  first  vertical  bank  of  switches,  one  of  PEs  0 
and  1  will  have  sent  its  value  to  the  high  tier,  and  one  to  the  low  tier. 
Similarly  with  PE s  2  and  3,  and  PEs  4  and  5.  Either  all  of  the  PEs  trying  to 


ascend 


descend 


7 


Figure  A2:  The  counter- example  proving  Theorem  2. 

£f  PEs  C  and  2  are  to  seed  values  tc  PE  C.  switches  0-1  and  2-3  oust  be  the  same  If 
PE s  3  and  5  are  to  send  values  tc  PE  2.  switches  2*3  and  4-5  oust  be  the  sane.  If 
PEs  1  and  4  are  to  send  values  to  PE  1.  switches  0-1  and  4-5  must  be  different.  This 
yields  a  contradiction 


reach  PE  0  at  the  end  must  be  in  the  same  tier  just  before  the  last  switch,  or 
the  switch  marked  *  would  have  to  be  an  ORUP.  This  switch  must  not  be  an 
ORUP,  however,  since  then  the  output  to  PE  1  would  be  undefined.  Thus,  all 
of  the  0’s  (the  values  heading  for  PE  0)  must  be  sent  to  the  same  tier.  Since, 
after  the  first  bank  of  switches,  only  the  next  to  last  switch  allows  values  to 
cross  tiers,  the  switches  labeled  0-1  and  2-3  must  either  both  be  STAY  or 
both  be  CROSS.  Now  what  can  the  setting  of  switch  4-5  be?  A  similar 
argument  as  the  one  used  for  the  switch  marked  *  yields  that  the  switch 
marked  4  must  not  be  ORUP,  so  the  2’s  must  all  be  in  the  same  tier.  Switch 
4-5  must  be  set  the  same  as  switch  2-3  and  thus  switch  0-1.  for  otherwise 
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the  2's  would  be  in  different  tiers.  Finally,  look  at  the  situation  for  the  l's. 
Obviously  one  of  the  l’s  will  be  in  the  high  tier  and  one  in  the  low  tier  if  the 
three  switches  are  set  the  same.  Thus,  the  switch  marked  •  would  have  to  be 
an  ORDOWN  to  get  the  l’s  to  PE  1.  and  we  know  this  cannot  be.  Therefore  no 
aetting  of  the  switches  will  allow  the  mapping  to  be  generated  and  the 
theorem  is  proved. 


Theorem  3:  A  mapping  of  the  share  type  may  be  accomplished  in  an  ascend 
followed  by  a  descend  followed  by  a  final  ascend.  Further,  the  first  ascend 
and  descend  implement  a  permutation  and  thus  require  only  the  STAY  and 
CROSS  operations. 

Proof:  In  the  Share  algorithm  we  only  care  that  the  data  gets  concentrated, 
not  into  which  PE  it  is  concentrated.  Thus,  we  will  arbitrarily  assign  the  first 
in  PEs  the  task  of  holding  the  concentrated  data  for  the  m  nodes  of  the 
associative  network. 

The  two  lemmas  below  are  sufficient  to  prove  this  theorem.  The  first 
aays  that  an  ascend-descend  pair  implements  a  general  permutation.  The 
oecond  shows  that,  from  a  particular  permutation  of  the  input,  a  single 
ascend  can  concentrate  the  data  in  the  manner  described  above. 

lamma  A:  As  ascend-descend  pair  may  implement  a  general  permutation. 

Proof  of  tenant  A:  This  lemma  is  well  known  in  the  literature.  The  original 
proof  was  by  Waksman  [1968].  Schwartz  [i960]  gives  a  proof  which  does  not 
use  any  discussion  of  ’’switches”  or  "connections”  but  instead  builds  up  the 
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solution  using  mappings.  Lev  [19B1]  gives  a  method  which  allows  the  control 
bits  to  be  computed  on  a  parallel  processor. 

1*"wm  B:  Consider  a  mapping  in  which  the  first  nc  PEs  all  have  PE  0  as  their 
target  (output),  the  next  nj  have  PE  1  as  their  target,  etc.  and  each  n*  is 
greater  than  zero.  Assume  that  there  is  a  Boolean  value  associated  with 
eacb  PE  and  the  Booleans  are  to  be  ORed  together  if  they  have  the  same 
target.  Then  a  single  ascend  can  implement  this  mapping  using  the  four 
operations  STAY.  CROSS,  ORUP  and  ORDOWN. 

Example: 

PE:  0  1  2  3  4  5  6  7 

Target:  0  0  0  1  1  2  2  3 

Value:  TFFFFFTF 

4 

PE:  0  1  2  3  4  5  6  7 

Value:  T  F  T  F  -  -  *  * 

Proof  of  Lemma  B:  This  proof  is  by  induction  on  the  number  of  initial  bits  in 
the  target  which  agree  with  the  current  PE.  The  claim  is  that  after  stage  i 
each  target  can  be  placed  in  a  PE  whose  PE  number  agrees  with  that  target 
In  the  first  i  bits.  Clearly  if  this  is  true  the  theorem  is  proved,  since  after 
stage  n-1  the  PE  number  will  be  exactly  the  target. 

For  stage  0,  we  need  to  move  Just  those  values  whose  target  disagrees 
with  the  current  PE  number  in  the  bit  0  position.  Uhat  could  stop  us  from 
being  able  to  move  these  values?  Suppose  PE  2k  and  PE  2k+l,  for  example, 
both  have  odd  targets.  Then  each  will  wish  to  place  its  value  in  PE  2k+l. 
Now  if  these  two  targets  are  the  same,  we  merely  use  an  OR  operation.  If  the 
two  targets  are  not  the  same  we  have  a  collision.  But  note  that  this  can  only 
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occur  if  both  targets  are  odd  and  different.  Thus,  the  targets  differ  by  at 
least  two.  The  initial  position,  however,  requires  that  PE  2k  and  PE  2k+3 
bold  targets  that  are  the  same  or  differ  by  exactly  one.  Thus  this  is  a 
contradiction  and  we  can  always  move  the  values  so  that,  after  st^ge  0,  each 
target  agrees  with  its  PE  number  in  bit  0. 

Now  suppose  that  all  targets  agree  with  their  respective  PE  numbers  in 
all  bits  from  0  to  i-1  and  we  are  at  stage  i.  We  claim  that  after  stage  i  we  can 
guarantee  that  all  targets  will  agree  in  the  first  i  bit  positions.  Once  again 
consider  what  it  means  to  have  a  collision.  We  will  have  two  targets  wrhicb 
need  to  agree  in  the  first  i  bit  positions  but  differ  in  some  higher  position 
(for  otherwise  the  targets  are  the  same  and  we  would  OR  them).  The  targets 
for  these  two  PEs  differ  by  at  least  210.  Two  targets  compared  at  stage  i 
started  within  21*1— 1  of  each  other  by  the  very  design  of  ascend.  (For 
instance,  at  bit  1.  PE  0  may  be  compared  with  the  original  value  from  PE  2  or 
PE  3  but  never  PE  4.)  Once  again  we  have  a  contradiction,  since  there  is  at 
least  one  target  for  each  of  the  first  k  PEs.  So  there  is  ho  way  that  two 
targets  starting  within  2**1— J  of  each  other  can  differ  by  at  least  2tM. 

The  proof  of  lemma  A  in  W&ksman  [1968]  and  our  proof  of  lemma  B  are 
both  constructive.  We  may  now  assign  to  each  node  of  the  associative 
network  a  unique  number.  The  many  PEs  which  make  up  that  node  will  have 
this  number  as  their  target.  We  then  use  lemma  A  to  order  those  PEs  as 
necessary  Tor  input  to  lemma  B.  Lemma  B  then  guarantees  that  can 
concentrate  the  data  into  the  first  k  PEs  of  the  system.  Having  completed 
this  construction  it  is  worth  noting  that  it  is  reversible.  We  ean  start  from 
the  newly  concentrated  information  and,  following  the  same  paths  in 
reverse,  return  the  ORed  bits  to  their  initial  location.  Thus  the  fcntire 


process  lakes  six  sweeps  to  complete. 

Further,  since  we  use  the  same  path  beck  as  we  used  forward,  no  extra 
control  information  is  necessary.  The  amount  needed  for  the  forward 
direction  is  2n  bits  per  ?£.  In  the  permutation,  ascend  and  descend  each 
use  one  bit  per  switch.  Since  there  are  n  switches  per  sweep  but  only  half  as 
many  switches  as  PEs,  the  ascend-descend  system  requires  only  n  bits  per 
PE.  In  the  concentrate  sweep  each  switch  is  "four-way"  and  thus  requires 
two  bits.  Thus  we  need  another  n  bits  per  PE. 

In  6  logz(K)  logical  steps  using  only  2  logj(N)  bits  per  processor  the 
share  algorithm  may  be  implemented  on  the  binary  n~cube. 

A-3  the  binary  n-cube  on  the  BVH 

Ascend  and  descend  may  be  implemented  on  the  BVM  at  a  cost  of  a 
constant  time  factor  above  that  necessary  on  the  binary  n-cube.  Preparata 
[1961]  describes  this  implementation  in  detail;  we  will  sketch  that  method. 

A  BVM  contains  2*  cycles  of  k  PEs  each,  so  we  have  the  same  number  of 
PEs  as  a  binary  n-cube  with  n=k+2k.  We  define  /T=2k  so  ascend  will  have 
k+K  phases.  The  first  k  phases  are  low  shea/  reorderings,  that  is 
reorderings  within  a  cycle.  The  last  X  phases  are  h$ph  shea/  operations  that 
bring  pairs  together  across  the  lateral  connection. 

Low  BheaT  Fbun 

Preparata  [1961]  gives  an  algorithm  which,  from  a  position  where  the 
PEs  have  bit  i  adjacency,  a  sequence  of  2*°-l  steps  yields  bit  i+ 1  sdjacency. 
For  cycle  length  X  equal  to  eight,  the  algorithm  gives: 


bit  0  adjacency:  0 — 1  2 — S  4 — 5  6 — 7 

0  1*2  34  5*6  7 

bit  1  adjacency:  0 — 2  1—3  4 — 6  5 — 7 

0  2  1  3*4  6  5  7 

0  2  1*4  3*6  5  7 

0  2  *4  1*6  3  *  5  7 

bit  2  adjacency:  0 — 4  2 — 6  1 — 5  3 — 7 


Tbe  arrows  in  the  above  diagram  denote  where  swapping  takes  place. 
Instead  of  using  this  algorithm  each  time  Ascend  is  called,  the  algorithm  is 
executed  once  at  startup  and  shuffle  bits  are  stored  in  each  PE  which  tell  it 
what  operation  to  perform  at  each  step.  The  number  of  shuffle  bits 
necessaiyr  turns  out  to  be  2x(K-k).  For  k=3.  the  2048  PE  machine,  10 
shuffle  bits  are  necessary;  for  ks=4,  24  bits  would  be  necessary.  A  small  price 
to  pay  to  avoid  a  relatively  complex  calculation  on  each  step  of  the  Ascend 
algorithm. 


High  Sheaf  Phases 


Each  cycle  of  the  BVM  has  K  lateral  connections  to  exactly  those  cycles 
that  differ  in  one  of  the  K  high-bit  positions.  Thus  tbe  following  simple- 
minded  algorithm  serves  to  implement  the  high  sheaf  phases  of  Ascend: 


FOR  i  :*=0  TO  K-l  DO  BEGIN 
FOR  j  :*  0  TO  K-l  DO  BEGIN 
apply  the  necessary  operation  between  the 
ith  PE  in  each  cycle  and  its  lateral, 
shift  the  values  within  a  cycle  to  the  right, 
cyclically. 

END; 

END; 


Variable  i  determines  the  current  high  sheaf  phase,  which  is  equivalent 
to  the  element  number  of  the  PE  within  a  cycle  that  is  active.  This  method 
is  easy  to  implement  but  obviously  yields  less  than  1/K  of  the  binary  n- 
cube's  performance,  since  only  a  single  PE  within  a  cycle  is  executing  the 
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operation  each  time  through  the  inner  loop. 


Pipelined  High  Sheaf 

For  the  cost  of  a  more  complex  implementation,  we  can  dramatically 
improve  the  high  sheaf  performance  by  using  a  pipelined  approach,  fie  will 
allow  a  value  to  proceed  through  the  phases  as  it  cycles  right  from  the 
zeroth  PE  in  the  cycle.  The  following  pseudo-code  is  sufficient: 


FOR  l  :*  0T0K-1  DO  BEGIN 
|  fill  pipeline  { 

apply  the  necessary  operation  between  the 

0  through  1th  PE  in  each  cycle  and  its  lateral, 
shift  the  values  within  a  cycle  to  the  right, 
cyclically. 

END; 

FOR  i  :*  0  TO  K-  J  DO  BEGIN 
J  empty  pipeline  ) 

apply  the  necessary  operation  between  the 
t+lth  through  Ktfc  PE  in  each  cycle  and 
its  lateral 

shift  the  values  within  a  cycle  to  the  right, 
cyclically. 

END; 


Now  the  FEs  are  kept  busy  half  the  time.  The  values  loop'  exactly  twice 
around  the  cycle  instead  of  the  K  times  of  the  previous  algorithm. 

This  method  seems  like  a  clear  winner  except  that,  at  any  moment, 
each  value  in  the  pipeline  is  at  a  different  phase  of  "ascent".  Since  the 
operation  depends  on  the  current  Ascend  phase,  this  method  requires  that 
the  control  bits  which  determine  the  operation  to  perform  be  reordered  so 
that  the  operations  will  occur  at  the  correct  time. 

An  ascend  on  the  BVM  will  take  four  times  as  long  as  it  would  on  a 
binary  n*cube  with  the  same  number  of  PEs.  One  factor  of  two  comes  from 
tbe  pipelining,  which  requires  twice  as  many  operations  to  be  performed. 
The  other  factor  arises  due  to  moving  the  data  around  tbe  machine.  Given 


04 

tbe  simple  operations  being  used  during  ascend,  each  movement  step  costs 
the  same  as  executing  an  operation.  Thus,  for  a  factor  of  four  in  speed  we 
may  use  tbe  BVM,  which  is  easy  to  layout  in  VLSI,  instead  of  the  binary  n- 
cube,  which  is  not. 
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APPENDIX  B 


Simulation  of  Parallel  Associative  Networks 


The  results  described  in  this  paper  have  been  verified  by  building  a 
simulator  of  such  a  system.  In  this  appendix  we  will  describe  the  computer 
project.  The  first  section  gives  a  brief  account  of  the  BVM  simulator  used. 
Section  two  discusses  the  program  which  calculates  control  bits  for  the 
SHARE  algorithm.  The  third  section  describes  the  SHARE  program  In  the 
fourth  section  we  look  at  a  program  which  converts  the  formal  description 
of  a  data  base  (figure  4.1)  into  input  for  the  data  base  simulator.  Finally  the 
data  base  simulator  is  described  and  sample  executions  shown. 

B-l  A  High-Level  Simulator  for  the  BVM 

• 

In  Jackoway  [1954]  a  high-level  simulator  for  the  BVM,  SAL.  is  detailed. 
This  section  will  give  a  summary  of  its  properties.  SAL  allows  the  user  to 
write  BVM  programs  in  standard  Pascal.  The  user  writes  a  Pascal  procedure 
which,  when  passed  to  SAL,  is  called  with  the  memory  of  each  PE  in  turn.  To 
•void  referencing  data  in  ways  not  possible  on  the  BVM,  the  procedure  is 
sent  four  parameters  by  SAL:  a  pointer  to  the  local  memory  of  the  current 
PE  and  read-only  pointers  to  the  memories  of  the  three  PEs  to  which  the 
current  PE  is  connected.  Jackoway  [1954]  describes  rules  which  eliminate 
usage  which  would  not  be  possible  on  the  BVM.  Basically  these  rules  restrict 
the  procedures  to  two  or  three  lines;  each  procedure  does  some 
fundamental  task  such  as  copying  a  word  or  ANDing  two  bits.  The  user 


Li. 


.  ■  .  VI'. 


v.; 


writes  a  bank  of  such  procedures  and  then  writes  his  program,  which  merely 
sends  these  procedures  to  SAL  in  the  appropriate  order. 

The  user  may  place  a  template  over  each  PE’s  memory.  This  template 
allows  the  user  to  use  Pascal  integers  es  well  as  booleans  in  the  user's 
programs.  Thus  one  might  decide  to  treat  the  first  sixteen  bits  as  booleans 
and  the  next  60  bits  as  three  twenty-bit  integers.  The  flexibility  allowed  by 
SAL  and  the  capabilities  available  from  Pascal  make  algorithm  development 
easier.  Since  SAL  is  not  an  assembler-level  simulator,  precise  timing  results 
cannot  be  obtained.  Instead  the  user  must  be  satisfied  with  a  count  on  the 
number  of  executions  of  each  user  procedure. 


B-2  Control  Bit  Calculation 

The  control  bit  program  takes  a  mapping  as  input  and  outputs  the 
control  bits  necessary  for  the  BVM  to  implement  a  mapping.  The  method 
used  is  the  two  step  process  suggested  in  the  proof  of  Theorem  3  in 
appendix  A.  The  first  step  follows  Waksman’s  algorithm  to  compute  a 
permutation  which  sorts  the  information  (Waksman  [1966]).  The  second 
srtep  uses  lemma  B  to  determine  the  final  ascend  control  bits.  Thus  to 
handle  the  following  mapping: 

Input  PE:  01234567 
Output  PE:  0  1  0  3  1  2  0  1 

the  lint  step  will  use  the  following  permutation 


Input  PE:  01234567 
Output  PE:  03174625 


to  bring  the  data  to  a  position  where  the  following  mapping  needs  to  be 
determined: 

Input  PE:  0  1  2  3  4  5  6  7 
Output  PE:  00011123 

Now.  lemma  B  may  be  applied. 

The  sorting  step  is  implemented  using  the  method  described  in 

Waksman  [1969].  The  control  bits  are  equivalenced  to  switches  in  the 

following  manner.  The  two  processors  involved  in  a  bit  i  relationship  have  a 

single  control  bit  which,  if  on  means  they  swap  values  (switch  CROSS),  if  off 

means  they  keep  their  original  values  (switch  STAY).  ORUP  and  ORDOWN  are 

never  used  during  a  permutation.  Since  the  permutation  is  implemented  as 

an  ascend-descend  pair,  each  pair  of  processors  will  meet  twice,  once  during 

ascend  and  once  during  descend.  The  smaller-numbered  processor 

maintains  the  ascend  control  bit.  the  larger-numbered  processor,  the 

* 

descend  control  bit. 

The  second  step  is  achieved  using  Lemma  B.  but  runs  in  reverse.  The 
control  bits  Tor  the  final  stage  are  determined  first.  This  final  stage  is  the 
only  one  that  allows  values  to  cross  from  the  lower  ball  of  the  permutation 
to  the  higher  half  and  vice  versa.  Thus,  we  can  determine  the  necessary 
switch  »ettings  by  noting  which  half  the  values  must  have  been  on  before 
the  final  stage.  Consider  the  mapping  we  have  been  using  throughout,  and 
compare  the  final  state  to  the  initial  state. 

PE:  T)  12314567 

Target:  0  0  0  1  |  l  2  2  3 

It  is  clear  that  0  will  only  come  from  the  0-3  half  of  the  target,  1  will  come 
from  both  halves,  and  2  and  3  from  the  4-7  half.  Thus,  at  the  final  stage,  0 


will  reed  operation  STAY,  1  will  need  operation  ORUP  (up  to  the  first  half), 
and  2  and  3  will  need  CROSS.  Now  we  can  determine  the  next-to-final  stage 
by  considering  the  following  two  subproblems. 

PE:  0  1  1 2  3  and  4  5 1 6  7 

Next-to-last:  0  1  j  -  -  -  1  |  2  3 

Target:  0  ojo  1  12  [23 

This  process  may  be  continued  until  all  switches  have  been  determined.  It 
takes  two  control  bits  to  define  a  switch;  one  bit  is  stored  in  each  of  the  two 
processors  connected  by  a  bit  i  relationship.  In  the  bit  0  relationship,  for 
instance  PEs  0  and  1  are  connected.  The  four  possible  switches  are  defined 
as  follows: 

STAY  CROSS  ORUP  ORDOWN 
PE  0:  0  1  0  1 

PE  1:  0  1  1  0 

«k 

Figure  B1  shows  a  sample  execution  of  this  program. 


B-3  Implementation  of  the  SHARE  Algorithm 

To  implement  the  SHARE  algorithm.  1  started  by  designing  and 
implementing  Ascend  and  Descend  (A/D).  A  n on-pipelined  version  of  A/D 
exists  as  well  as  the  pipelined  version  described  in  (Preparata  [1981]).  The 
advantage  of  the  non-pipelined  version  comes  in  debugging  algorithms. 
Using  the  pipelined  version,  at  any  point  in  time  each  piece  of  data  within  a 
cycle  is  at  a  different  phase  of  ascent  or  descent.  Finding  bugs  is  nearly 
impossible  under  this  condition.  Thus,  higher  level  algorithms  may  be  tested 
axing  the  non-pipelined  version  and  then  converted  to  the  faster  pipelined 


version. 
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Rapping  tc  generate: 

0  1  2  3  4  5  e 

0  6  7  0  0  0  e 


7  E  *  1C-  11  II  13  14  15 

4  7  s  I  1  2  b  7  1 


To  Decide  Snitches:  (This  is  the  permeation  for  Baksaar’s  algorithm 

0  9  13  1  2  3  10  B  14  11  6  4  7  12  13  5 

(Results  of  Baksaan's  algoritha) 

Snitch  I  0  STAY  STAY  STAY  STAY  STAY  STAY  STAY 

Snitch  I  1  STAY  CROSS  CROSS  CROSS  CROSS  STAY  STAY 

Snitch  *  I  STAY  CROSS  STAY  CROSS  CROSS  STAY  STAY 

Snitch  #  *  CROSS  CROSS  CROSS  STAY  CROSS  CROSS  CROSS 

Snitcr.  4  4  CROSS  STAY  STA-  CROSS  CROSS  CROSS  STA' 

Snitch  I  !■  CROSS  STAY  CROSS  STAY  STAY  STAY  CROSS 

Snitch  I  t  5TAV  STAY  STAY  STAY  STAY  STAY  CROSS 

Snitct  I  7  STAY  CROSS  CROSS  CROSS  CROSS  CROSS  CROSS 


Tc  DCs  IT:  (Letia  B  algorithm 


v  0 

-  0  0 

1  1  I 

2  4  6  6 

6  6  7  7 

0  l 

2  3 

4  5  6 

7  -1  -1  -1 

-1  *1.  -1  -1 

(Results  of 

leaaa  B  algorithm,  the  nuabers  are  the  lone' 

processor  of  the  tit 

0:0F:U? 

0:0RUP 

.  O.-STAY 

OiSTAY 

2: DRIP 

1 : STAY 

t: CROSS 

l:STAY 

liORBOW 

4; STAY 

2: CROSS 

2:  STAY 

6:0R’dr 

5:STAY 

3: STAY 

3:0RS0BN 

B: CROSS 

8:0RDDBA 

1: CROSS 

4: CROSS 

10:  OMR 

9:  STAY 

9jSTAY 

5iDRDDBYi 

J2.-STAY 

12: CROSS 

10.-0RDDBN 

6: CROSS 

14:0RD0BN 

13;0M0BR 

11 {STAY 

7:CR0SS 

J 

-1 


Rgure  Bl:  Semple  run  of  control  bit  calculation  program 


Having  routine*  Ascend  end  Descend  in  place,  the  next  step  involved 
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introducing  the  control  bits  computed  by  the  program  described  in  the 
previous  section.  It  is  not  sufficient  to  place  the  control  bits  in  the 
processor  to  which  they  are  assigned  by  this  program.  In  the  low  sheaf  and 
high  sheaf,  the  data  is  shifted  around  and  so  must  be  the  control  bits. 
Although  ODe  could  predetermine  where  each  control  bit  will  be  needed,  a 
simpler  method  is  used.  The  control  bits  are  sent  around  the  cycle  along 
the  same  path  that  the  data  will  flow  during  a  SHARE  and  each  bit  is 
"dropped"  in  the  processor  where  it  will  be  needed. 

Due  to  the  cost  of  simulating  a  2046  PE  machine  on  a  single  processor, 
only  the  concentrate  half  of  SHARE  has  been  implemented.  This  is  sufficient 
since  the  second  half  involves  using  the  same  control  bits  in  reverse. 


B.4:  The  Data  Base  Simulator 

Since  SHARE  is  so  expensive  to  simulate,  in  the  data  base  simulator  an 
inexpensive  version  or  SHARE  is  used.  (This  version  violates  DVM  constraints, 
but  it  is  the  only  routine  used  in  the  data  base  simulator  that  has  this  trait.) 
SHARE  may  also  be  used  to  print  out  the  concentrated  values,  tbus  it 
doubles  for  PRINT. 

A  MATCH  procedure  is  available  which  handles  most  boolean  assignment 
wtatements  which  depend  on  TYP  and  REL  values.  The  parameters  to  MATCH 
are:  a  TYP  field  value,  a  REL  field  value,  an  ATYP  field  value,  an  associated 
mark  bit  number,  and  the  mark  bit  number  of  the  bit  to  set.  Any  of  the  field 
walues  may  be  set  to  "ANY"  (0  is  used);  the  associated  mark  bit  may  be  set  to 
*N0NE"  (again  0  is  used).  The  MATCH  routine  sets  the  mark  bit  in  those 
processors  whose  fields  match  the  field  values  and  whose  associated 
processor  has  the  associated  mark  bit  on.  MATCH  can  be  said  to  compute 
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the  following  boolean  function: 

(TYP  *  TYP  field  value)  k  (REL  =  REL  field  value)  k 

(ATYP  =  ATYP  field  value)  k  (associated  mark  hit  on) 

Other  procedures  are  available  for  boolean  operations,  integer 
operations,  copying  integers,  and  an  IF  routine.  As  well  as  these  simple 
procedures,  the  procedures  described  in  the  text  have  been  written.  These 
routines  include  INHERIT.  MARKALL  and  MINIMIZE.  The  following  pages  show 
annotated  runs  of  the  data  base  simulator. 
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Having  routines  Ascend  and  Descend  in  place,  the  next  step  involved 
introducing  the  control  bits  computed  by  the  program  described  in  the 
previous  section.  It  is  not  sufficient  to  place  the  control  bits  in  the  processor 
to  which  they  are  assigned  by  this  program.  In  the  low  sheaf  and  high  sheaf, 
the  data  is  shifted  around  and  so  must  be  the  control  bits.  Although  one 
could  predetermine  where  each  control  bit  will  be  needed,  a  simpler  method 
is  used.  The  control  bits  are  sent  around  the  cycle  along  the  same  path  that 
the  data  will  flow  during  a  SHARE  and  each  bit  is  ’’dropped'*  in  the  processor 
where  it  will  be  needed. 

Due  to  the  cost  of  simulating  a  2048  PE  machine  on  a  single  processor, 
only  the  concentrate  half  of  SHARE  has  been  implemented.  This  is  sufficient 
since  the  second  half  involves  using  the  same  control  bits  in  reverse. 


B-4  Data  Base  Entry  Prcgram 

The  data  base  entry  program  accepts  a  data  base  description  of  the 
form  shown  in  figure  4.1.  Each  line  begins  with  the  name  of  a  relation  and 
contains  the  names  of  pairs  of  nodes  which  are  to  be  connected  by  that 
relation.  The  program  alphabetizes  all  of  the  words  to  determine  the 
numerical  value  assigned  to  each  node  and  relation.  Once  the  numerical 
assignments  are  made,  the  PE  assignments  are  made.  Each  PE  is  given  the 
number  of  the  node  to  which  it  belongs  and  the  relation  in  which  it  is  used. 
These  assignments  are  determined  so  that  the  pair  of  PEs  representing  an 
arc  are  connected  by  a  lateral  link.  The  numerical  and  PE  assignments  are 
saved  for  use  by  the  control  bit  calculation  program  and  the  data  base 


[A  printout  of  the  TV?  values  for  the  f;rst  32  pr cresses 
folios.  The  first  processor  has  value  Is  in  hexadecias) 

•kith  is  24  in  deciaai.  This  is  a  **J ohr. *  processor.] 

state  of  the  aachine: 

001c  OCT!  0015  001?  00i2  0023  CCl*  0G1D 

OOiA  0014  0015  0021  001A  0025  GC-lA  002B 

O0OF  001m  0016  0010  OCll  OGlr  001?  001! 

ooc:  0025  0018  OCll  0015  00 15  0222  002! 

[Me  Mill  calculate  ’grandchildren  of  John' 

First,  HUTCH  is  called  to  set  lord  3  to  True  in  all  processors 
«hich  have  INVERSE  PARENT  link  to  a  JOHN  node. 

All  of  the  infonatior  trtucfc  is  not  ir  (racists  til’  aas  produced 
by  the  prograe.  Inforaatio"  in  curly  craciets  till  51)/  is  a 
sub' out  me  call. 

Mote  that  the  naees  feeioa  were  printed  fc>  the  prograe  anch  loots  uc 
the  values  in  the  dictionary  built  fiv  the  data  base  program 
The  nuabe*  in  parenthesis  after  a  nate  is  the  value  assigned  t:  that 
type. 

Mete  also  that  m  this  iapleaertation.  ail  things  are  storec 
in  aords,  booiear.s  have  value  1  for  TRuE,  0  for  FAlEE.j 

1(1  berdt!3  <*  REL*  INVERSE  PARENT '*32  l  AT  TP*  JOHN!  24.'  }]} 

til  5 HARE  boril'}  } / . 

Ichild'en  of  John:! 

TYPES  ON:  .  JACM17:1)  JILL(20:1> 

Ifirandchildren  are  found  by  turning  on  those  nodes  ahich  have 
an  INVERSE  PARENT  link  to  a  node  with  aord  3  on] 

U1  MordUl  <-  REl*  INVERSE  PARENT(»32)  l  ANcrdlSMrue  ))) 

{{{  SHARE  Mordl4]  ))) 

[grandchildren  of  John.-] 

TYPES  ON:  JAKE 1 18:1)  J0AKi2S:l)  JOE (23:1) 


[Now  we  proceed  to  the  exaeple  ’Mhc  are  parents  or  tar  do;  owners’*] 

{{{  Herd:::  <-  REL=  ISAile)  t  ATY?=  DOSfn  ))} 

{{{  SHAPE  KordI33  )}) 

[dogs:] 

TYPES  Oh;  FIDOi  12: 1  >  PD0?-£Y i3fc:  1 ) 

{[{  Mardl4]  <•  REL=  COLDS i 6/  t  fiTYr-  ThK-39;  }>] 

ill  SHAPE  Mord-4]  ))) 

I  tar.  things.*] 

TYPES  Oh:  CORVETTE (7:1)  FiBDil2:D  JILL (20:!) 

HARK;2':1) 

[First  m  ml]  determne  (tan  dog)  owners] 

{{[  Nord[S]  <-  WordE3]  l  dord[43  )}) 

[Mord  5  is  set  true  in  tan  dogsl 
[{(  Mo'dle)  <-  REL*  ONhCli  t  AKordtSM  )}} 

Hi  SHARE  KordlE;  }}} 

[Jake  :s  the  (tar  dog)  owner] 

TYPES  Oh:  JAKE  <16:1  .• 

{({  h:rdI7]  ••  R£l=  PAPE  XT  (3:.-  t  to;rtlt>7 

{[{  SHARE  hordl?]  })! 
dale's  parents:! 

TYPES  Gh:  m  117:1) 

[how  we  will  determne  tan  idog  owni’s)] 

{{{  irdlS]  <*  PEL*  OKTOl!  I  Aiordi33*T  }]] 

{((  SHARE  hard]*]  '.)) 

[doc  owne* s:] 

TYPES  0*.:  JAKE t IE:  1)  JlLLCO:’) 

{{{  iordle]  t-  KordM]  1  MordI5)  ]}) 

[herd  6  is  on  only  in  Jill  nodes,  since  color  or  Jake  is  Mhite) 

{({  Hord[7]  <-  REL1  PARENT (32)  t  AMordIfc3*T  )}) 

{{{  SHARE  hord[7]  ))} 

[Jill’s  parents.*] 

TYPES  Oh:  JAN£i!?;l>  JOHN (24; I) 

[A  suaaary  or  the  run  Follows. 

Me  have  executed  8  NATCH  instructions,  2  Booleans  (both  B’s) 
and  8  Binary  shares  (we  used  operation  OF.  between  values). 

By  the  values  which  art  tabulated,  this  run  would  take 
only  one  Billisecond  on  the  BVH. ] 

II  Matches:  8  ibools:  2  lints:  0  tbin  shares:  6  tint  shares:  0  Isteps:  0  II 
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